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1 Introduction 

The classification of the totally geodesic submanifolds in the most important Riemannian sym- 
metric spaces of rank 2 , namely the 2-Grassmannians, is an interesting and significant problem of 
Riemannian geometry. The totally geodesic submanifolds in the oriented real 2-Grassmannians 
G^(]R"~''^) (equivalent to the complex quadrics Q" C CP""*"^ ) have already been classified in 
my paper [K] ; in the present paper I will solve the classification of totally geodesic submanifolds 
in the complex and the quaternionic 2-Grassmannians. 
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It should be mentioned that aheady Chen and Nagano gave what they claimed to be a 
complete classification of the isometry types of maximal totally geodesic submanifolds in all 
Riemannian symmetric spaces of rank 2 in §9 of their paper |CN] based on their (M_|_,M_)- 
method. However, as it will turn out in the present paper, their classification is faulty: several 
types of totally geodesic submanifolds are missing from their list, both for the space 6*2 (C""^^) 
and for the space G2(H"+2) ; see Remarks [521 and [72{ a) for a more detailed description. Even 
apart from these omissions, Chen's and Nagano's investigation is not satisfactory, as they name 
only the isometry type of the totally geodesic submanifolds, without giving any description of 
their position in the ambient space. (Such a description might, for example, be constituted 
by giving explicit totally geodesic, isometric embeddings for the various congruence classes of 
totally geodesic submanifolds, or at least by describing the tangent spaces of the totally geodesic 
submanifolds (i.e. the Lie triple systems) as subspaces of the tangent space of the ambient 
symmetric space in an explicit way.) 

Besides the results of Chen and Nagano, various other partial results concerning totally 
geodesic submanifolds in Grassmann manifolds have been obtained: For example. Wolf has 
obtained a classification of the totally geodesic submanifolds of the 1-Grassmannians (i.e. the 
projective spaces) in [W2j. In [Wlj and |W2j he also classified those totally geodesic submanifolds 
of a Grassmannian manifold Gr(IK") in which any two distinct elements have zero intersection 
as subspaces of IK" ; it turns out that such totally geodesic submanifolds are necessarily of rank 
1 . We will use the latter classification result by Wolf here to handle one specific case of the 
general classification of totally geodesic submanifolds in G2(IH") (namely the case where the 
submanifold has constant "characteristic angle" j ; it will turn out that it then satisfies the 
hypothesis of the classification by Wolf). 

Some specific types of totally geodesic submanifolds have been classified in all Riemannian 
symmetric spaces M . The two most important results of this kind are the classification of 
refiective submanifolds (i.e. those submanifolds of M which are connected components of the 
fixed point set of an involutive isometry on M) due to Leung (see |Le) ) and the classification 
of totally geodesic submanifolds of maximal rank due to Zhu and Liang (see jZLj ). Moreover, 
Nagano and Sumi gave a classification of totally geodesic spheres in Riemannian symmetric 
spaces in [NaSj . 

These partial results notwithstanding, the problem of classifying all totally geodesic submani- 
folds of arbitrary rank in Riemannian symmetric spaces still remains open, even for the symmetric 
spaces of rank 2 . 

The usual strategy for the classification of totally geodesic submanifolds in a Riemannian 
symmetric space M = G/K , which is used also here, is as follows. Let g = t © m be the 
decomposition of the Lie algebra of G induced by the symmetric structure of M . As it is 
well-known, the Lie triple systems m' in m (i.e. the linear subspaces m' C m which satisfy 
[[m',m'],m'] C m') are in one-to-one correspondence with the (connected, complete) totally 
geodesic submanifolds M^' of M running through the "origin point" po = eK S M , the 
correspondence being that M^' is characterized by po G M^' and Tp^M^' = T(m') , where 
T : m — 5- Tp^M is the canonical isomorphism. 

Thus the task of classifying the totally geodesic submanifolds of M splits into two steps: (1) 
To classify the Lie triple systems in m , and (2) for each of the Lie triple systems m' found in 
the first step, to construct a (connected, complete) totally geodesic submanifold M^' of M so 
that po £ Mm' and T^'^iTp^M^i) = m' holds. 
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2 General facts on Lie triple systems 



Herein, step (1) is the one which generally poses the more significant difficulties. As an 
approach to accomplishing this step, we describe in Section [2] for an arbitrary Riemannian 
symmetric space M of compact type relations between the roots and root spaces of M and the 
roots resp. root spaces of its totally geodesic submanifolds (regarded as symmetric subspaces). 
These relations provide conditions which are necessary for a linear subspace m' of m to be a 
Lie triple system. However, these conditions are not generally sufficient, and therefore a specific 
investigation needs to be made to see which of the linear subspaces of m satisfying the conditions 
are in fact Lie triple systems. This investigation is carried out for G2(]H"'''^) in Section [5l it is 
the laborious part of the proof of the classification theorem (Theorem 15. 3|) . 

It should be emphasized that to carry out this investigation for a given Riemannian symmetric 
space, it does not suffice to know the (restricted) root system (with multiplicities) of that space, 
or equivalently, the action of the Jacobi operators R{ ■ , v)v on the various root spaces. Rather, 
full control of the curvature tensor is needed. For this reason, we give a description of the 
curvature tensor, and associated objects like the Cartan subalgebras, the roots and the root 
spaces, of G2(IH"+^) in Section El We further prepare the classification by giving an explicit 
description of the orbits of the isotropy action of G2(]H"'*"^) in Section 01 

The central part of the present paper is the classification of the Lie triple systems in G2(]H"'^^) , 
which is carried out in Section [SJ the result is found in Theorem 15.31 By inspection of the root 
systems (with multiplicities) of the various Lie triple systems found, we can already tell the 
local isometry type of the corresponding totally geodesic submanifolds of G2(]H""'"^) . But to 
determine the global isometry type, some more considerations are needed. Also it is desirable to 
describe the actual totally geodesic submanifolds corresponding to the various types of Lie triple 
systems as explicitly as possible. This is done in Section [6l 

Finally, we classify the Lie triple systems and the totally geodesic submanifolds of G2(C"'''^) 
in Section[71 Because G2(C""''^) is a totally geodesic submanifold of G2(]H"+^) , we can obtain 
this classification simply by checking which of the totally geodesic submanifolds of G2(1H"''''^) 
are contained in a given totally geodesic G2(C""'"^) C ^2(13""''^) . 

The results of the present paper were obtained by me while working at the University College 
Cork under the advisorship of Professor J. Berndt. I would like to thank him for his dedicated 
support and guidance, as well as his generous hospitality. 

2 General facts on Lie triple systems 

In this section we suppose that M = G / K is any Riemannian symmetric space of compact type. 
We consider the decomposition g = 6 © m of the Lie algebra g of G induced by the symmetric 
structure of M . Because M is of compact type, the Killing form x : g x g ^ IR, (X, Y) i— > 
tr(ad(X) o ad(y)) is negative definite, and therefore ( • , • ) := — c • x gives rise to a Riemannian 
metric on M for arbitrary c G IR+ . In the sequel we suppose that M is equipped with such a 
Riemannian metric. 

Let us fix notations concerning flat subspaces, roots and root spaces of M (for the corres- 
ponding theory, see for example |Lo] . Section V.2): A linear subspace a C m is called flat if 
[o, a] = {0} holds. The maximal flat subspaces of m are all of the same dimension, called the 
rank of M (or m) and denoted by rk(M) or rk(m) ; they are called the Cartan subalgebras of 
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m . If a Cartan subalgebra a C m is fixed, we put for any linear form A € o* 

mA := { X G m I VZ G a : adiZfX = -\{ZfX } 
and consider the root system 

A(m, a) := { A e a* \ {0} | + {0} } 

of m with respect to a. The elements of A(m, a) are called roots of m with respect to a, 
for A G A(m, a) rtiA is called the root space corresponding to A, and nx := dim(mA) is called 
the multiplicity of the root A . If we fix a system of positive roots A^^- C A(m, o) (i.e. we have 
A_(_U(— A_|_) = A(m, a) ), we obtain the root space decomposition of m: 

m = e mA . (1) 

A6A+ 

The Weyl group W(m, a) is the transformation group on a generated by the reflections in the 
hyperplanes { w G a | X{v) = } (where A runs through A(m, o) ); it can be shown that the root 
system A(m, a) is invariant under the action of Ty(m, o) . 

Let us now consider a Lie triple system m' C m , i.e. m' is a linear subspace of m so that 
[[m',m'] , m'] Cm' holds. In spite of the fact that the symmetric space corresponding to m' 
does not need to be of compact type (it can contain Euclidean factors), it can be shown easily 
that the usual statements of the root space theory for symmetric spaces of compact type carry 
over to m' , see [K] . 

More specifically, the maximal flat subspaces of m' are all of the same dimension (again called 
the rank of m'), and they are again called the Cartan subalgebras of m' . For any Cartan 
subalgebra a' of m' , there exists a Cartan subalgebra o of m so that o' = o n m' holds. With 
respect to any Cartan subalgebra a' of m' we have a root system A(m', o') (deflned analogously 
as for m ) and the corresponding root space decomposition 

m' = a' © (2) 

QGA+(m',o') 

(with a system of positive roots A_|_(m', a') C A(m', a') ); we also again call n'^ := dim(m^) the 
multiplicity of a G A(m', a') . A(ro', a') is again invariant under the action of the corresponding 
Weyl group W{m',a') . It should be noted, however, that in the case where a Euclidean factor 
is present in m' , A(m',a') does not span (a')* . 

The following proposition describes the relation between the root space decompositions ([2]) of 
m' and ([T]) of m . In particular, it shows the extent to which the the position of the individual 
root spaces of m' is adapted to the root space decomposition ([T]) of the ambient space m . 
We will base our classification of the Lie triple systems in G2(III") on these relations. 

Proposition 2.1 Let a' be a Cartan subalgebra of m' , and let a be a Cartan subalgebra of m 
so that a' = a n m' holds. 

(a) The roots resp. root spaces of m' and of m are related in the following way: 

A(m', o') C { A|a' | A G A(m, o), A|o' / } . (3) 

Va G A(m',a') : m;, = 0A6A(m,a)mA n m' . (4) 

V \\a'=a J 
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(h) We have rk(ra') = rk(m) if and only if o! = a holds. If this is the case, then we have 

A(m',o') C A(m,a) , Va G A(m', a') : = n m' . (5) 

Proof. See [K], the proof of Proposition 2.1. □ 

For the remainder of the section, we fix a Cartan subalgebra a' of m' , and let a be any 
Cartan subalgebra of m so that a' = a n m' holds. 

Definition 2.2 Let a G A(m',a') be given. Recall that by Proposition \2.lV a) there exists at 
least one root A G A(m, a) with \\o! = a . We call a 

(a) elementary, if there exists only one root A G A(m, a) with \\o! = a; 

(b) composite, if there exist at least two different roots X, fj. £ A(m, a) with A|o' = a = fi\a' . 

Elementary roots play a special role: If a G A(m', o') is elementary, then the root space m'^, 
is contained in the root space rriA , where A G A(m, o) is the unique root with A|o' = a. As 
we will see in Proposition 12.31 below, this property causes restrictions for the possible positions 
(in relation to o' ) of A . The exploitation of these restrictions will play an important role in the 
classification of the rank 1 Lie triple systems of G2(IH") in Section f5.2[ 

It should also be mentioned that in the case rk(m') = rk(m) we have o' = a , and therefore in 
that case every a G A(m',a') is elementary (compare Proposition 12.1( b)). 

For any linear form A G a* we now denote by A'* the Riesz vector corresponding to A , i.e. the 
vector a" G a characterized by ( • , A") = A . Here (•,•) = —c • x is again the inner product 
obtained from the Killing form x of g . 

Proposition 2.3 Let a G A(m',a') be given. 

(a) If a is elementary and A G A(m, a) is the unique root with A|o' = a , then we have A" G a' . 

(b) If a is composite and A, /i G A(m, a) are two different roots with X\a' = a = /i|a', then 
a" — /u" is orthogonal to a' . 

Proof. For (a) see the proof of Proposition 2.3(a). (b) is obvious. □ 



Proposition 2.4 Suppose that a G A(m', o') is a composite root such that there exist precisely 
two roots X, fJ. A(m, a) with X\a' = a = /i|o'. Further suppose that can be written as a 
linear combination a" = a A" + 6 with non-zero a, 6 G IR . 

Then we have a,b > , and there exists a linear subspace C mx and an isometric linear 
map $ : m\ so that 

m', = {x + ^^x)\xem'x} (6) 
holds. In particular we have n'^ < min{n>,,n^} . 

Proof. First we note that the hypotheses imply that A and ^ are linearly independent: Assume to the contrary 
that /X = cA holds with some c £ ]R; we have c ^ {0, 1} . We would then have a" = a A" + fe/i" — {a + fee) A" — 
(ia + fe)/!** , which because of 7^ a = A|n' = ^|a' implies l = a + fec= ^a + fe. The equality a + fee = ia + 6 
implies a = —cb because of c 7^ 1 . Thus we have a + fee = , in contradiction to 1 = a + fee . 

In the sequel we make use of the fact that for every A G A(m, 0) and every v G rriA , there exists one and only 
one vector v £ t which is "related" to v in the sense that 

WH ea : ( a.d{H)v = X{H) ■ d and a.d{H)v = -X{H) -v) (7) 

holds; we then also have 

[v,d]^\\vf-XK (8) 
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(For example, see [Loj . Lemma VI. 1.5(a), p. 62.) The analogous statement holds in the Lie triple system m' . 

Let us fix H £ a' with a{H) 7^ , and let v G m'a be given. By Proposition a) there exist unique vx G ttia 
and Vf_i G m,i so that v — v\ + Vf^ holds. We now calculate R{H, v)v in two different ways: On the one hand, we 
have 

R(H,v)v = -[[H,v],v] 5 -a{H) ■ [v,v] 1 a{H) ■ \\vf ■ a" = a{H) ■ \\vf ■ {a\^ +b^l^) ; (9) 
in particular we see R(H, v)v G 0' C a . On the other hand we have 

R{H,vx)vx = \{H)-\\vxf -X^ and R{H,v^)v^, = ^Ji{H) -Wv^f ■ 

by the analogous calculation as in © , and therefore 

R{H,v)v = R{H,vx)vx + R{H,v,,)v^ + R{H,vx)v^ + R{H,v^,)vx 

= a{H) ■ (||«Af A" + Wyj"" fi») + R{H,vx)v^ + R{H, v^)vx_ . 

(•) (t) 

Both R{H,v)v and the term marked (*) are members of a, whereas the term marked (f) is a member of 
TTiA+M ffi TTiA-M , and is therefore orthogonal to (the linear independence of A and /i implies A ± 7^ 0). It 
follows that (f ) vanishes, and thus we have 

R{H,v)v = a{H) ■ {\\vxf A« + fi*) . (10) 

By comparing Equations ((Oj and (|10p we now obtain 

ll^f ■(aA«+6M«) = |l«Af A« + |l^;^|lV» 

and therefore because of the linear independence of A and /i 

||ua||^ = a • ||u||^ and Hi'mH^ = &■ 11^11^ . 

It follows that we have a,b > , and that the linear maps 

^A : ^ TTiA , V = Vx + I-* ^vx and $p : rn^, v = vx + Vf^ 1-^ ^ Vf_, 

are isometric, in particular they are injective. Now consider the linear subspace m'x :~ ^x{^'a) of mx and 
the linear isometry <1> :— <1>^ o (<I>a)~^ : hia ^ . For any v = vx + G as before, we have "I>(i'a) ~ 
^fj.i^x^ (vx)) ~ ^^(\/av) = y^v^ and therefore v = vx + •\J^^{'">^) ■ Hence we have shown ((6]|. It follows that 
n„ — dim(mQ) = dim(mA) < dim(mA) ~ nx holds; by exchanging the roles of A and ^ we also get n'^ < . □ 



3 The curvature tensor of quaternionic 2-Grassmannians 

Generalities on quaternionic linear spaces. We denote by H the skew-field of quaternions, by c 
the conjugate of a quaternion c G IH and by Im(]H) := { c G IH | c = — c} the reaI-3-dimensional 
space of purely imaginary quaternions. A canonical basis of Im(H) is an orthonormal basis 
{i,j,k) of Im(H) so that k = ij holds. For any c G IH , we denote by Re(c) := ^(c + c) G IR 
its real part, and by Im(c) := ^(c — c) G Im(IH) its imaginary part. 

Let y be a symplectic space, i. e. a right-linear space over H equipped with a quaternionic 
inner product (•,•): x 1/ —> IH , its homogeneity rule is 

Vt>, w G V, c, c £ JH : {vc, wc) =c-{v,w)- c (11) 

in accordance with the usual conventions, v J- w stands for {v,w) = 0. We denote by S{V) := 
{v G V\{v,v) = 1} the unit sphere in V . A symplectic basis of y is a basis (ai,...,a„) 
of V so that {a^,ay) = 5^^ holds. The Lie group Sp(y) := {i? G End(y) | Vv, tt; G V : 
{Bv, Bw) = {v, w) } is the symplectic group of {V, {■ , ■)) ; its Lie algebra 5p(y) is isomorphic 
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to the Lie algebra {X £ End(y) | X* = —X } of skew-adjoint H-linear endomorphisms on V , 
equipped with the commutator [X, Y] := X o Y — Y o X as Lie bracket. Finally, we note that 
the quaternionic inner product also gives rise to a real inner product ( • , • )]r := Re(( • , • )) on 
V seen as a real linear space; v ±]r w stands for (w, it;)]^ = . 

To introduce on V besides the given right-multiplication also a left-multiplication, we need 
to single out a real form Vjn of V (i. e. Vjn is an IR- linear subspace of V with dim]R(l^) = 
dimiH(T^) , such that V^n ■ i is IR-orthogonal to V]r for every i G Im(]H) ). Then we define the 
left-multiplication with some given c G IH as the right-H-linear extension of the IR-linear map 
(^IR ■ c), V vc, note that cx = xc holds for every x G F]r . The left-multiplication is 
described explicitly by 

VcGH, F : c-v = A{A{v) -c) , 

where A : V ^ V is the H-linear involution characterized by A\Vjr = idyjj^ and A\V^ = 

-idy± . 

Let V and V' be symplectic spaces. We denote the space of H-right-linear maps V' ^ V 
by L{V',V) , and put End(y) := L{V,V) . For every / G L{V',V) there is a unique adjoint 
map f* G L{V, V') characterized by 

yv,wer : {fiv),w) = {v,r{w)); 

if (ai, . . . ,a„) is a symplectic basis of V' , then /* is explicitly given by 

yveV : nv)=^a,-{fia,),v) . (12) 

Let us now suppose that real forms of V' and of V have been singled out, and let us 
denote the left-multiplications defined thereby by : y ^ F', v ^ cv and L^'-V v ^ 

cv (for c G H). Then L{V' ,V) becomes a H-right- and H-left-linear space by the definitions 
(for cGH and /GL(y',F)): 

/ • c := / o and c- f := LcO f . 

Note that if / maps into Vjr , then we have c- f = f ■ c. 

The quaternionic 2-Grassmannian and its tangent space. Let F be a symplectic space of 
dimension n > 2 and V' be another symplectic space of dimension 2 . In the sequel we will study 
the quaternionic 2-Grassmannian G2{V' (BV)= G2(Si"'~^'^) , i.e. the manifold of 2-dimensional, 
quaternionic subspaces of V' (B V . It is well-known that this Grassmannian is an irreducible 
Riemannian symmetric space of compact type and rank 2 with respect to the natural action 
of Sp{V' V) on it. The isotropy group of this action at the point V G G2iV' V) is 
{Be Sp{V' e V) I B{V') = V'}^ Sp{V') X Sp(y) , hence G2{V' V) is isomorphic to the 
quotient manifold Sp(y' © V)/Sp{V') x Sp{V) . 

The symmetric structure on G2 {V © V) is induced by the involutive Lie group automorphism 

a : Sp(y' y) ^ Sp(y' y), sbs-^ , 

where S G Sp(F' © V) is the symplectic involution characterized by S\V' = idy/ and S\V = 
—idv ■ The linearization of cr is a Lie algebra involution on the Lie algebra sp(F' V) of skew- 
adjoint endomorphisms on V' (BV . It induces the Cartan decomposition sp{V' F) = 6 m 
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corresponding to the symmetric structure; we have 

« = { X G sp{v' e V) I x{v') c y' } = sp{v') e sp{v) , 

m = {X e sp{V' e V) I X{V') C V, X{V) CV'} ^ L{V', V) , 

where the isomorphisms are given by fi — > sp{V') © sp{V), X i-^ (-'^l^'; -'^l^) and m 
L(V', V), X X\V' . In the sequel, we will identify the isotropy algebra t with sp(y)©sp(y) , 
and the tangent space m of G2{V' V) with L{V', V) in this way. 

We equip m = L{V', V) with the usual quaternionic inner product for spaces of linear maps: 
Let (ei, 62) be any symplectic basis of V , then we put for vi,V2 & xn 

{vi,V2) := ('yi(ei),V2(ei)) + (^1(62), ^2(62)) ; 

this definition does not depend on the choice of the basis (ei, 62) . Moreover, this inner product 
is invariant under the action of the isotropy group Sp(y) x Sp(y) of G2{V' ®V) on m , which 
is given by 

= {Bi, B2) G Sp(y') X Sp(F), v G m : Bv = B2OV0BI . (13) 

Therefore the corresponding real inner product ( ■ , • )]r := Re(( • , ■ )) gives rise to an invariant 
Riemannian metric on G2{y' ®V);we will view G2(F' © V) with this metric from now on. 

The Lie bracket and the curvature tensor. It is now easy to get the following formulas for 
the Lie bracket, which are valid for all X, y G 6 (say X = {Xi,X2) and Y = (11,12) with 
Xi,Yie sp{V') and ^2,^2 e sp{V) ) and u,v em^ L{V', V) : 

[X,Y] = {[XuYi], [X2,Y2]) G i, 
[X,v] = X20 V + v o XI G m , 
[u, v] = {v* o u — u* o V , V o u* — u o V*) G 6 . 

Therefrom we obtain the following formula for the curvature tensor R of G2{V' © V) via the 
well-known relationship R{u,v)w = —[[u,v],w] : 

R{u, v)w = {uv* — vu*)w + w{v*u — u*v) . (14) 

Conjugations on m . Our next aim is to describe all Cartan subalgcbras of m . In order to be 
able to do so in an efficient way, wc introduce the concept of a conjugation on V' : Let 

21 := { A G Sp(F') I A'^ = idv, A 7^ ±idy/ } ; 

we call the ^ G 21 conjugations on V' . Any ^ G 21 is symplectically diagonalizable, and its 
eigenvalues are 1 and — 1 , each with (quaternionic) multiplicity 1 . It follows that A induces the 
decomposition V' = V^IA) © VL{A) into the quaternionic- 1-dimcnsional eigenspaces V^{A) := 
Eig(^, ±1) . This decomposition of V also gives rise to a decomposition of m = L{V',V), 
namely, we have m = L^{A) © L-(A) with the quaternionic-n-dimensional spaces L±{A) := 
{v e m.\v o A = ±v} = {v e m \ ■u|F:^(A) = } . — It is also a consequence of the consideration 
of the eigenvalues of G 21 that 21 is a conjugacy orbit in Sp(y) . 

It should be noted that in this setting, there is no canonical isomorphism between V^(^) and 
VL{A) , nor between L^{A) and L-{A) . To describe such isomorphisms, we define 

ZA--{Je Sp(F') I J2 = -idy., JoA = -AoJ}. 
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Any J S interchanges V^(^) and V!^{A) by an isomorphism which respects the inner 
product on V' . Moreover, the map m— >m, v ^ v o J defines an isomorphism between Lj^{A) 
and L_ [A) which respects the inner product on m . In the sequel we will also write J{v) for 
V o J when f G m . 

If A G 21 , J ^ Za and a unit vector e+ G V^+C^) is given, we put e_ := J(e-i-) G VLiA) , 
then (e+, e_) is a symplectic basis of V . We call any such symplectic basis adapted to {A^ J) 
or simply adapted to A . 

Cartan subalgebras. 

Proposition 3.1 Let a C m he a 2- dimensional real subspace. Then a is a Cartan subalgebra of 
m if and only if there exists ^ G 21 and an orthonormal basis {H^,H^) of a with H± G L±{A) 
and H+{V[{A)) ± H_{VL{A)) . 

Proof. First we suppose that there exists a basis {H+,H-) of o as in the proposition. Using Equation (|12|l 
and the fact that we have H± £ L±{A) , one sees that H-H!\. = H+Hl = holds; using the same equation 
and the property H+{Vj^{A)) _L H-{VL{A)) , one further finds H^H- = H1H+ = 0. From these equations it 
follows via Equation p4|) that R(Hj^,H-)H± — holds. Therefore o is flat, and hence a Cartan subalgebra of 
m because its dimension 2 equals the rank of G2 {V © V^) . 

Conversely, let a be any Cartan subalgebra of m . Because any two Cartan algebras of m are conjugate under 
the isotropy action on m (see [H], Theorem V.6.2, p. 246), the Cartan subalgebra is conjugate to a Cartan 
subalgebra of the type described in the proposition, and therefore itself of that type. □ 

Roots and root spaces. Let a = IRi/+ © IRif_ be a Cartan subalgebra of m as in Proposi- 
tion EH 

For the purpose of describing the roots and root spaces of m , we let (a+,a_) be the basis 
of the space a* of IR-linear forms on a which is dual to {Hj^,H^) . Moreover we fix a basis 
(e+,e_) of V adapted to A, and define for any c G IH and e G {±1} the H-linear map 
Mif+'"-) G L{V',V) by 

M(f+'-)(e+) = ^i/„(e_)-c and Mif+'-)(e_) = ^eF+(e+) • c . (15) 

We consider the real form := spanij^{e+, e_} of V and fix a real form Vjn of V with 
i/+(e+), (e_) G Fir . We define left multiplications on V' and on V with respect to these real 
forms, and consider L{V', V) as a IH-left- and H-right-linear space via these left multiplications. 
Note that we then have c • H± = H± ■ c for any c G IH . 

The following table gives the roots A of G2{V' (B V) with respect to the Cartan subalgebra 
a , the corresponding root spaces mx and the multiplicities nx ; these data are easily derived 
from Equation (jl4p : 



A 


mx 


nx 


Ai := 


{v 


GL4 


.{A)\v{e+)±H+{e+),H.{e.)} 


4n - 8 


A2 := a- 


{v 


G L- 


{A)\v{e.)±H+{e+),H^{e-)} 


4n - 8 


A3 := Q!-|- + a_ 






{Mi;_Y-^|cGlH} 


4 


A4 := a+ — a_ 






{Mi''i+'"-)|cGlH} 


4 


2Ai 






Im(H) • H+ 


3 


2A2 






Im(H) • H_ 


3 
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4 The orbits of the isotropy action on G2(IH"'~'~^) 

Note that the root spaces (of course) do not in fact depend on the choice of the adapted basis 
(e+,e_) which appears in their description. However, the individual vectors Mc^i^'^~^ do depend 
on the choice of the basis; in fact we have for any c,q+,q^ G IH with \q±\ = 1 : 

c,£ ^^^q-cq+,£ V 

From the table of roots we obtain the following, well-known root diagram for G2 {V' ® V) : 

2X2 

• 

A2 

• • 'As 

• • O • Ai • 2Ai 



Remark 3.2 Of course, the descriptions in the present section can easily be generalized to 
general quaternionic Grassmannians Gr(K^~^^) , as well as to Grassmannians over IR or C . In 
particular. Equation (fT^ for the curvature tensor is valid in the general setting. 

4 The orbits of the isotropy action on G2(IH"''"^) 

Proposition 4.1 Suppose v £ m\{0} . 

(a) The endomorphism v*v £ End(y) is self-adjoint and positive semi-definite. Conse- 
quently v*v is real diagonalizable with real eigenvalues ti,t2 > 0. They satisfy the re- 
lation ti -\- t2 = \\v\\'^ , hence there is a unique angle ip{v) G [0, f] so that {ii,t2} = 
{\\v\\'^ cos((/9(f ))^, sin((/?(f ))^} holds. We call ip{v) the characteristic angle of v . 

(h) If a is a Cartan subalgebra of m with v £ a (such exist, see [H], Theorem V.6.2, p. 246), 
there exists an orthonormal basis {H^,H^) of a of the kind described in Proposition \3.1\ 
so that 

V = \\v\\ ■ {cos{ip{v)) H+ + sm{ip{v))H^) (17) 
holds. We call any such presentation a canonical representation of v . 



-a! 
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4 The orbits of the isotropy action on G2 (IH"'"'" ) 

(c) The sets 

Ct:={v£§{m)\^{v)=t} witht£[0,^] 

are the orbits of the isotropy action of Sp{V') x Sp(F) on the unit sphere S(m) . 

Proof. For (a). It is obvious that v*v is self-adjoint, and for any e £ V' we have {e,v*ve) = {v e,v e) > , 
hence v*v is positive semi-definite. It foUows that v*v £ F,nd{V') is real diagonalizable, and that its eigenvalues 
ti,t2 are > 0. Let 61,62 be unit eigenvectors corresponding to ti resp. t2 which are (in case ti = t2) IH- 
orthogonal to each other. Then (61,62) is a symplectic basis of V' , and therefore we have 

= {v,v) = {vei,vei) + (t; 62, u 62) = {ei,v*vei) + {62, «*« 62) = ti + t2 . 

Thus ip{v) can be defined as in the proposition. 

For (b). Let a be a Cartan subalgebra of m with v £ a. By Proposition 13.11 there exists y4 G 21 and 
an orthonormal basis {H+,H-) of a with H± G L±{A) and H+{Vl{A)) _L H-{VL{A)) . Then there exists 
s G [0, 2tt) so that 

w = Hull • (cos(s)J/+ -f sin(s)i?__) (18) 

holds. By changing the signs of A , H+ and H- where necessary, we can ensure that v lies in the closed Weyl 
chamber delimited by the root vectors X{ = H+ and Ag — H+ + H- ; then we have s G [0, . 

It follows from Equation (|18|) that v*v is described by the matrix ^ ( )^ ) respect to any 

basis (e+, e_) adapted to A ; this shows that s — ip{v) holds. Therefore (|18p is a canonical representation for v . 

For (c). First, let v G S(m) and {Bi,B2) G Sp(V") x Sp(V) be given, and let v := B2VBI be the result of 
the isotropy action of (_Bi, 52) on v . Then we have by Equation (|13p 

v*v — Bi V* B2 B2 V Bi — Bi {v*v) Bl . 

Thus v*v and v*v are Sp(T/')-conjugate to each other, and therefore have the same eigenvalues. This shows that 
'^{v) = ifiiv) holds. 

Conversely, let v,v G S(m) be given with (p{v) = (p{v) =: s . Then let 

u = cos(s) 1/4. -I- sin(s) and v = cos{s) H+ + sin{s) H- (19) 

be canonical representations of v resp. v (with H± G L±(A) and H± G L±{A) , where A, A G 21, and 
H+{Vl{A)) _L H-(VL{A)), H+{Vi{A)) _L i/_(Vl(I))). There exists (^1,^2) G Sp(V") x Sp{V) so that 

-Bi(6±) = e± and B2{H±{e±)) = H±ie±) 

holds, where (e+,6_) resp. (e^+,e^_) is any basis adapted to A resp. to A. By Equations (|19p we then have 
B2 V Bl =v,80 V and v are members of the same orbit of the isotropy action on §(m) . □ 

Remarks 4.2 (a) A vector w G m \ {0} is singular, i.e. contained in more than one Cartan 
subalgebra of m , if and only if v lies on the boundary of a Weyl chamber, i.e. if and only 
if ip{v) £ {0, j} holds. It follows that for < ip{v) < j , the canonical representation (fT7|) 
is unique. 

(b) By Proposition 14.1( c). the submanifolds Ct are the orbits of the isotropy action of a rank 2 
Riemannian symmetric space on the unit sphere. It follows from results of Takagi and 
Takahashi, see |TTj . that {Ct)Q^^^E is a family of isoparametric hypersurfaces on the 
sphere; the submanifolds Co and C^/^ are the focal manifolds of this family. 

The characteristic angle j plays a special role in many circumstances. This is, for example, 
evidenced by the fact that for w G m \ {0} with {p{v) = j , the canonical representation (fT7|) of 
V can be obtained with respect to any A £ Another specialty of that characteristic angle is 
exhibited in the following lemma and proposition. 

Lemma 4.3 Let v £ and let 7^, : IR ^ G2{V' © V) be the geodesic of G2{V' © V) with 

7^(0) = V and %(0) = v . Then for any t £ JR either 7^(t) = V or 7^(t) nV = {0} holds 
(where in the last equation we regard 7t,(t) and V' as quaternionic linear subspaces of V (BV )■ 
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5 The classification of tlie Lie triple systems in G20^ ) 

Proof. Let v £ C,r/4 be given. As explained in Section |3] v £ m = L{V' ,V) can also be (and originally 
was) regarded as an element of sp{V' V) ; in block matrix notation with respect to V' OV , v corresponds to 
X ~ {° "f ) £ sp(V' © V) . Then the geodesic 7„ is given by jv{t) = exp{tX) ■ V' , where exp : sp{V' © V) ^ 
Sp(V' © V) is the exponential map of Sp(V' © V) . 

Because of ^p{v) = j Proposition 14.1 f a) shows that v*v — ^ id^/ holds. Using this fact one easily calculates 
for u > 1 

and for v >G 

x2-+i = (_i)'^X. 

Therefrom we obtain 

exp(tX) = ^ l,{txr = id + ^ j:ty{txr + E 

i/>0 v>l v>0 

v>l i/>0 

= id + (cos(i/%/2) - 1) ( 2 1' ) + V2 sm{t/V2) ( « ) . 

Denoting by (ei, 62) any symplectic basis of V' , we thus have 

7„(t) = exp{tX) ■ V' = span^jj cos(t/^) ei + V2 sin(f/^) v{ei) , cos{t/V2) €2 + V2 sm{t/V2) ■0(62) } . 

Because of ip{v) — j the vectors ei , 62, v{ei) and t;(e2) are all non-zero, and pairwise H-orthogonal. Therefore 
we see that that jvit) = V' holds if and only if we have sin(t/\/2) = 0, i.e. t G Z(7r\/2) , and that otherwise 
7„(t) n V = {0} holds. □ 

Proposition 4.4 Suppose that M is a connected, totally geodesic submanifold of G2{V' (B V) , 
such that there exists U £ M so that (p{v) = j holds for every v € TjjM \ {0} . Then 
Uir\U2 = {0} holds for every C/i, C/2 G M with Ui ^ U2 ■ 

Proof. Without loss of generality, we may suppose M to be complete, and therefore a symmetric subspace of 
G2{V' © V) . Then some subgroup of the isotropy group K of G2{V' © V) acts transitively on M , and therefore 
the condition ip{v) — j for every v G TuM\ {0} holds with respect to every point U £ M . We may also assume 
without loss of generality that Ui = V' holds. 

Because M is a connected and complete, totally geodesic submanifold of G2{V' © V) , there exist v G 
and t > so that the geodesic 7^ : IR ^ G2{V' © V^) with jviO) = V' — Ui and 7i,(0) = v satisfies 7u(t) = U2 ■ 
We have f/i 7^ f/2 , and therefore Lemma |4 . 3 1 shows that Ui r\U2 = {0} holds. □ 

The totally geodesic submanifolds M of Grassmannian manifolds with the property that 
Ui n U2 = {0} holds for every Ui,U2 S M with Ui / U2 have been classified by Wolf 
in [Wlj and [W2 j. Via Proposition 14.41 we will be able to apply Wolf's results to obtain a 
classification of the totally geodesic submanifolds of G2(y' ® V) whose tangent spaces have 
constant characteristic angle j as part of the proof of the classification of all totally geodesic 
submanifolds in G2{V' © V) in Section [5] of the present paper. 

5 The classification of the Lie triple systems in G2(Si^^^) 

Definition 5.1 Let V be a symplectic space. An IR-linear subspace U C V is called 

(a) quaternionic or of HP-type (H, dim]H(C/)) , if U ■ c C U holds for every c G H; 

(b) totally complex (with respect to some i G §(Im(]H)) ) or of HP-type (C, dim([!([/)) , if 
U -icU and U -j ^trU holds for every j € (]Ri)-L'i"(H) ; 

(c) totally real or of HP-type (IR, dim]F{,(f/)) , if U ■ c J-k U holds for every c G Im(H) ; 

(d) of HP-type (S'^) , if U is a real-3- dimensional subspace of a space U' C V of MP -type 
(H,l). 
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5 The classification of tlie Lie triple systems in G20^ ) 

Clearly, no subspace of V can be of more than one MP-type. 

For any name t of a IHP-type, we define the dimension dim(r) and the width w^t) of r ; 
// T is of the form (K, k) with K € {IR, C,]H} , we put dim(r) := k and w{t) := dim]F{,(K) G 
{1,2,4} . For T = (S^) we put dim(r) = 1 and w{t) = 3. Then in any case the spaces of 
HP-type r have real dimension w{t) ■ dim(r) . 

Remark 5.2 As is well-known (see jW2] . §3), the Lie triple systems in a tangent space TpHP" 
of the quaternionic projective space HP" are exactly those IR-linear subspaces which have an 
HP-type of dimension < n ; two Lie triple systems are conjugate under the isotropy action of 
Sp(l) X Sp(n) on TpHP" if and only if they are of the same HP-type. The totally geodesic 
submanifolds of HP" corresponding to Lie triple systems of type (M,i), (C,^), (IR, £) and 
(§3) are isometric to HP^ , CP^ , IRP^ and §^ C = HP^ , respectively. 

As was explained in the Introduction, the pivotal point of the classification of the totally 

geodesic submanifolds in a Riemannian symmetric space is the classification of its Lie triple 

systems. In the present section, we solve the latter problem for the quaternionic 2-Grassmannians 
G2(H"+2) . 

We remain in the situation of the preceding two sections. In particular m = L(y' , V) is the 
tangent space of the quaternionic 2-Grassmannian G2{V' © V) . 

Theorem 5.3 Let {0} ^ m' be an IR-linear subspace of m . Then m' is a Lie triple system if 
and only if m' is of one of the following types: 

• (Geo, (p = t) , where t G [0, f ] . 

We have m' = M.v with some v G S(m') of characteristic angle (see Proposition \4-l^ 
ip{v) = t . 

• (IP, ip = 0, t) , where r is the name of a IHP-type with dim(T) < n . 
There exists A G 2t so that m' is a subspace of L^{A) of IHP-type r . 

• {S,(p = arctan(|), , where £ G {2, 3} . 

There exist A £ 'Ql , a basis (e+,e_) adapted to A, G L^{A) , G L_(A) with 
\\H±{e±)\\ = 1 and (i^+(e+), i7_(e_)) = 0, and a canonical basis {i,j,k) of Im(H) so 
that 

^ (3F+ + F_) , mI:^-^ + , M^r-) + 

V ' 

only for £ = 3 

is an orthonormal basis of m' ; here M'f^''^^'^ is defined by (jlSp . 

• (IP, (p = arctan(^), r) , where r is the name of a ^V-type with dim(r) = 1 and w{t) < 
n — 1 . 

There exist ^ G 21 , J G 5a > « basis (e+, e_) adapted to (^4, J) , G S(L„(A)) , a w{t)- 
dimensional real subspace Q C H with 1 £ Q , a totally real, w{t)- dimensional subspace 
U C L+(A) with U _L J{H^) , and an ^-linear isometry Q : Q ^ U so that 

m' = {qH_+2e{q)\qe Q} 

holds. 

• (IP, (f = arctan(|), (IR, 2)) , if n > 3 . 
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5 The classification of tlie Lie triple systems in G2(Si ) 

There exist ^ G 21, J £ ^a, o, basis (e+,e_) adapted to (A, J) , G ^+(^) o-i^d 
H-,wo & L-(A) , where i?+(e+), i?_(e_), wo(e_) are pairwise JH.- orthogonal, so that 

is an orthonormal basis of m' . 

(IP, if = arctan(|), (C, 2)) , if n > 4 . 

There exists a Lie triple system xn" of m of type (P, (p = arctan(i), ((D, 1)) - with the data 
mentioned in the description of that type - and wq G §(L_(^)) with H- , wq and J{U) 
pairwise JH- orthogonal, so that if we put := G S(L+(yl.)) and let i G S(Im(]H)) 
be so that Q = IR © IR i holds, we have m' = m" © m'^ , where m'^ is the JR-linear space 
spanned by the orthonormal system 

(IP, ip = arctan(|), (IH, 2)) , if n>b. 

There exists a Lie triple system m" of m of type (IP, </? = arctan(^), (IH, 1)) - with the 
data mentioned in the description of that type - so that with := 0(1) G §(L_|_(A)) we 
have m' = m" © m'^ , where 

< = { M^+''-^ - j^{j{eii))ci + J{@ij))cj + Jieik))ck) I cGH } 
and {i,j,k) is any canonical basis of Im(IH) . 

(IP, (f = -f 5 t) , where r is the name of a JHP-type with dim(T) < ^ . 
There exists ^ G 2t, J & Za, two subspaces Wi,W2 of L^{A) of JHP-type r (if t = 
((D, i) : with respect to the same i G S(Im(IH)) ) with Wi _L W2 , and an anti-linear isometry 
Q:Wi^W2 so that 

m' = {x-\-J{e{x))\x e Wi} 

holds. 

(s^¥' = f)• 

There exists A £ a basis (e+,e_) adapted to A, and H± G S(L±(^)) with 

{H+{e+),H_{e-)) = so that m' = JR{H+ + H_) ® { Mj'+''-^ | c G IH } holds. 

(G2, r) , where r is the name of a JHP-type with dim(r) < n and r 7^ (§^) . 

There exist A G 21, J E and a subspace U C L^{A) of JHP-type r so that m' = 

UeJ{U) holds. 

(IP X IP, Ti, T2) , where ti and T2 are names of 'MP-types with dim(ri) + dim(T2) < n . 
There exist ^ G 21, J £Za o-nd subspaces Ui,U2 C L^{A) of JHP-type ri resp. T2 with 
Ui -L U2 , so that we have m' = Ui @ J{U2) ■ 
(§1 X S^,^) , where 2<i<5 holds. 

There exists A G 21, a basis (e+,e_) adapted to A, H± G S(L±(A)) with 
(i7-l-(e+), iy_(e_)) = and an JR-linear subspace C G JH of real dimension £ — 1, so 
that m' = IRi?+ © IRi?_ © { M^'^+'''-^ I c G C } holds. 

(SP2) • 

There exists an JH-linear isometry ^ : V' ^ V so that m' = o X \ X e sp{V') } holds. 
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5 The classification of tlie Lie triple systems in G20^ ) 

• (Qs) . 

There exists a Lie triple system in' = U (B J{U) of type (G2,(C,2)) (where U is totally 
complex with respect to i G Im(H) ), and a vector v G S(ffi') with (p{v) = j , so that m' is 
the IR-ortho- complement of TRv (BTRv i in m' . 
We call the full name {Geo,ip = t) , (IP,y' = 0, r) etc. corresponding to a Lie triple system 
the type of that Lie triple system. If we identify 

(]PxP,ri,r2) = (PxP,r2,ri) 
(Geo, (/9 = 0) ^ (P, = 0, (]R, 1)) 
(Geo, = arctan(i)) = (P, = arctan(i), (P, 1)) 
(Geo,(^ = f)^(P,(^ = f,(P,l)) , 



then no Lie triple system is of more than one type, and two Lie triple systems are of the same 
type if and only if they are congruent under the isotropy action of Sp(2) x Sp(n) acting on m . 
Moreover, the various types of Lie triple systems have the following properties: 



type of m' 


dim]R(m') 


rk(m') 


m' maximal 


(Geo, f = t) 


1 


1 


no 


(P,(/p = 0,r) 


w{t) dim(T) 


1 


for T = (H, n) 


{S,(p = arctan(|),^) 


£ 


1 


no 


(P,(/9 = arctan(i),r) 


w{t) dim(T) 


1 


if n = 4 : for T = (S^) ; i/ n = 5 ; for T = (H, 2) 




w{t) dim(T) 


1 


no 


(s^^ = f) 


5 


1 


no 


(G2,(]K,1)) 


2 dimK(K) 


1 


if n = 2: for TK = m 


(G2,r), dim(T) > 2 


2w{t) dim(T) 


2 


for T = (H, n — 1) or T = ((D, n) 


(PxP,ri,r2) 


w{ri) dim(ri) +w{t2) dim(r2) 


2 


for Tu = (H, 4) with ii + £2 = n 


(§1 X s^^) 


l + £ 


2 


if n = 2 : for £ = 5 


(SP2) 


10 


2 


if n = 2 


(Qs) 


6 


2 


no 



Remark 5.4 The following types of totally geodesic submanifolds are missing from the entry 
for G2(]H"^^) in the claimed classification of maximal totally geodesic submanifolds of rank 2 
Riemannian symmetric spaces in Table VIII of |CNj : 

(a) (§1 X S^5) (isometric to {^^^^^^ x §l^^^^)/{±id} , maximal in G2(H^) ) 

(b) (P, (f = arctan(|), (S^)) (isometric to , maximal in G2(1H^) ), 

(c) (P, ip = arctan(i), (H, 2)) (isometric to HP^ , maximal in G2(]H^) ). 

While the totally geodesic submanifolds of type (S^ x S^,5) are reflective in G2(H'^) (the 
complementary type is (Sp2) ) and therefore can, for example, be found in the classification of 
reflective submanifolds of Riemannian symmetric spaces due to Leung, see |Lej . the submanifolds 
of type (P, if = arctan(^), r) have, to my knowledge, never been described before. 

Moreover, the existence of totally geodesic submanifolds of type = arctan(|),^) (iso- 

metric to S^), while not maximal in any G2(Si^~^^) (rather, the type (P,p = arctan(^),3) is 
maximal in Sp(2) ), can not be deduced from Table VIII of [CNj either. Also this type of totally 
geodesic submanifold has, as far as I know, not been described before. 
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5 The classification of tlie Lie triple systems in G2(S1 ) 

Remark 5.5 There is an alternative description of the Lie triple systems of types (IP, (p = 
f,(C,£)) and (]P,(/p = f,(H,^)): 

m' C m is of type (F, ip = j, (C, i)) (resp. of type (P, = j, (H, £)) ) if and only if there exists 
A e 21, J G , a totally real (resp. totally complex), 2^-dimensional subspace W C L+{A) 
and an orthogonal (resp. anti- linear and orthogonal) map H :W^W with = -idw so that 

m' = {x + J{E{x))\x eW} 

holds. 

The remainder of the present section in concerned with the proof of Theorem 15. 3i 
It is straightforward to see that the spaces mentioned in the theorem are indeed Lie triple 
systems, either by explicit calculations via Equation (|14|) or by checking that the embeddings 
described in Section E] are indeed totally geodesic and correspond to spaces of the mentioned 
types. It is also easily seen that two spaces of the same type are congruent under the isotropy 
action, and that the dimensions and ranks given in the table are correct. 

To show that no two Lie triple systems of different type are congruent, it mostly suffices 
to note that two Lie triple systems for which the corresponding totally geodesic submanifolds 
have different isometry types (as given in Section [6]) cannot be congruent. This only leaves the 
distinction between (G2,(K, 1)) and (P, (/9 = 0, (K, 2)) (for IKe{P,C,H}). To show that 
these types indeed are not congruent, we consider the normalizer group of Lie triple systems 
of the types involved under the action of the Sp(y )-factor of the isotropy action on m . The 
isomorphism type of these normalizer groups in dependence on the type r of the Lie triple 
system m' is given in the following table: 



T 


(G2,(]R,1)) 


(P,ip = 0, (R, 2)) 


(G2,(€,l)) 


(P,</p = 0, (C,2)) 


(G2,(H,1)) 


(P,</3 = 0, (H,2)) 


normalizer 


SO(2) 


0(1) X 0(1) 


SU(2) 


U(l) X U(l) 


Sp(2) 


Sp{l) X Sp(l) 



Because the normalizers corresponding to (G2, (K, 1)) and (P, ip = 0, (IK, 2)) are of different 
isomorphy type in each case, the Lie triple systems of these types cannot be congruent under 
the isotropy action. 

For the data in the table on the maximality of the various Lie triple systems, we presume that 
the list of Lie triple systems given in the theorem is complete. We first show why the Lie triple 
systems claimed to be maximal indeed are. For the Lie triple systems of rank 1 , note that such 
a Lie triple system can only be contained in another Lie triple system of rank 1 with the same 
characteristic angle (p (see Section U]), or in one of rank 2 . Using this fact, we see by inspection 
of the various types that Lie triple systems of the type (P, v = 0, (H, n)) are maximal, and that 
(G2, (H, 1)) is maximal if n = 2 holds. Also, if n = 5 holds, then (P, ip = arctan(^), (H, 2)) is 
maximal: Assume to the contrary that there exists a Lie triple system m" with m' C m" C m . 
Then m" must be of rank 2 , and the root system of m" must contain A2 and A4 with a 
multiplicity of at least 4 , also Ai and 2A2 with a multiplicity of at least 3 . This shows that 
m" is of type (G2,(IH, 5)) and therefore equals m in contradiction to our assumption. A similar 
consideration shows that (P, (p = arctan(^), (S^)) is maximal if n = 4 holds. 

For the Lie triple systems m' of rank 2 , note that such a Lie triple system can only be 
contained in another Lie triple system m" of rank 2 , and if A(m', 0) and A(m", a) are the root 
systems of these two Lie triple systems with respect to a Cartan subalgebra a C m' , we have 
A(m', a) C A(m", a) and na{m") > na{m') for every a e A(m', a) . Using this fact, we see that 
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Lie triple systems of the types (G2, (H, n — 1)) and (G2, {(C,n)) are maximal, and also that if 
n = 2 holds, then Lie triple systems of type (S^ x §^,5) and (SP2) are maximal. Finally, one 
sees by a consideration of the explicit description of the types of rank 2 that Lie triple systems 
of type (P X P, (H, ii), (H, £2)) with £1 + £2 = n are maximal. 

That no Lie triple systems are maximal besides those mentioned above follows from the facts 
in the following table: 



Every Lie triple system of type ... 


is contained in a Lie triple system of type ... . 


(Geo, f = t) 


(P xP,(P,l),(P,l)) 


(P, ip = 0,t) with dim(r) < n — 1 


(P,(/p = 0, (H,n)) 


(P, (/? = 0, (K, n)) with IK G {P, C} 


(P,(/p = 0, (H,n)) 


(S, if = arctan(i), ^) 


(SP2) 


(P, (p = arctan(i), (IK, £)) with IK G {P, C} 


(G2,(]K,£ + dimK(K))) 


(P, (f = arctan(i), (S^)) if n > 5 


(P,V9 = arctan(i),(H, 1)) 


(P, if = arctan(i), (H, 1)) if n > 6 


(G2,(H,5)) 




(PxP,r,r) 


(s^v' = f) 


(§1 X §5,5) 


(G2, (K, £)) with IK G {P, C} and ^ < n - 1 


(G2,(IK,n)) 


(G2,(H,£)) with £<n-2 


(G2,(H,n-l)) 


(G2,(P,n)) 


(G2,(C,n)) 


(P X P,ri,r2) with not both (H,4) 


(P X P, (H, dim(ri)), (H, dim(r2))) 


(P X P, (H, £1), (H, £2)) with £i + £2<n-l 


(P xP,(H,£i),(H,n-£i)) 


(§1 X S^£) with £<A 


(§1 X §5,5) 


(§1 X S^5) if n > 3 


(G2,(H,2)) 


(SP2) if n > 3 


(G2,(H,2)) 


(Qs) 


(G2,(C,2)) 



We now focus on the main problem, namely the proof that the list of Lie triple systems given 
in the theorem is indeed complete. 

As was emphasized before, for a classification of the Lie triple systems, it is not sufficient to 
know the root system (with multiplicities) of the symmetric space under investigation; rather 
one has to know the structure of the curvature tensor in all three variables in order to understand 
the actual transformations it induces between the various root spaces. 

The required description of the curvature tensor R is in our situation, i.e. for the symmetric 
space G2(y' (BV) , essentially provided by Equation ()14p . However, the more explicit description 
of R we now give, and which easily follows from Equation (|14p . is often more handy and will 
be used frequently throughout the classification. For this, we let A G 21, u±,v± £ L±{A) and 
tt; G m be given. Then we describe the linear map R{u±,v±)w G m = L{V' , V) by stating the 
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5 The classification of tlie Lie triple systems in G2(IH"'~'~'^) 
image of an arbitrarily fixed basis (e+, e_) adapted to A : 



e+ ^ u+ie+) {v+{e+),w{e+)) - w+(e+) {u+{e+),w{e+)) + 2w{e+) Im((w+(e+), u+(e+))) 
^ u+{e+) {v+{e+),w{e-)) - v+{e+) (u+(e+), u;(e_)) 

(20) 



X je+ ^ ^i^(e-) (v-(e-),M+(e+)) 
R{u+,v-)w = < (21) 
le_ -ti;(e+) (u+(e+),v__(e_)) 



R{u-,V-)w 



e+ ^-(e^) (u_(e_),u;(e+)) - W-(e_) (n_ (e_), ii;(e+)) 

1-^ u_(e_) (e„), t(;(e_)) — (e_) (n_ (e_), ii;(e_)) + 2 tt;(e„) Im((t;_(e_), u_(e_))) 

(22) 



Because the Riemannian symmetric space G2{y' ® V) is of rank 2 , any Lie triple system m' 
of m has either rank 2 or rank 1 . We will handle the classification for the two different ranks 
separately, in the following two subsections. 

5.1 The case of rank 2 

In this subsection we let a Lie triple system m' of m with rk(m') = 2 = rk(m) be given. Let 
us fix a Cartan subalgebra a of m' , then a also is a Cartan subalgebra of m . Then we have 
the root systems A := A(m, a) and A' := A(m',a') of m resp. m' with regard to a, and 
consequently the root space decompositions 

m = © tTiA and m' = a' © m'^ . (23) 

AeA+ aeA'^ 

Proposition 12.1( b) shows that we have 

a! = a, A' c A, Va G A' : m'^ = rriQ n m' . (24) 

We now write down the action of the curvature tensor between certain root spaces explicitly; 
these formulas (whose derivation again requires the understanding of the full curvature tensor) 
will play an important role in the classification: Because m' is a Lie triple system, u,v,w £ m' 
implies R{u, v)w £ m' ; the formulas therefore permit to derive from the presence of certain 
vectors in m' the presence of certain other vectors in m' . 

In relation to this, we note that by Proposition 13.11 there exist j4 S 21 and an orthonormal 
basis iH+,H^) of a with H± e L±{A) and H+{Vl{A)) ± H^{VL{A)) . 



Lemma 5.6 Let J £ 2a oind (e_(_,e_) he any basis adapted to {A, J) . We define Mc^^ := 
Mc'^i^''^^^ as in Equation (jl5p . 

(a) Action on m^i and m^a • Let u+,v+ G m;^^ and U-,V- G be given. Then we have 

i?(i7+, u+)t;+ = (n_|_(e-t-), f+(e+)) -ff+ and i2(-ff_, n_)t;_ = (n_ (e_), t;_ (e_)) if_ . 

(b) From rtiAi to mx^ and vice versa, via mx^ or mx^ ■ Let c G H, e G {±1}, 
w+ G rriAi and W- G m.\^ be given. Then we have 

R{H^,Mc,e)w+ = ^J{w+)-c and R{H+, Mc,s)w^ = J{w-) ■ c . 
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5 The classification of tlie Lie triple systems in G2(IH"'"'"^) 

(c) From mx^ to mx^ and vice versa, via mx^ or mx2 • Let n+,u+ € , n , u_ e 
rriAj , c G H and e € {±1} he given. Put dj^ := Im((i'-|_(e+), U-|-(e4_))) and d^ : = 
Im((t;_(e_),n_(e_))) . Then we have 

Riu+,V+)Mc,e = M^d+,-e + M^d+,s and R{U-,V-)Mc,s = Md_c,-e - Md_c,e ■ 

(d) From triAa to 0x^4 and vice versa, via m2Ai ^2X2 • Let d G Im(IH) , c G H 

and e G {±1} he given. Then we have 

R{H+,dH+)Mc,e = M_2cd,-e and R{H^,dH^)Mc,e = M_2dc,-e ■ 

(e) From Tn2Ai to Tn2A2 ond vice versa, via m2Ai © tTi2A2 • Let c, c G H, d G Im(IH) 

and e G {±1} he given. Then we have 

R{dH+, Mc,e)M^,-e = Re(dcc) H+ + e Im(cdc) H_ 
and R{dH_ , Mc,e)M^_^ = -e Im(cdc) H+ + Re(ccd) H_ . 

(f) From m-Ai ® triAs to ttias © nxA4 • Let u_|_ G ttiai , G tf^c? e G {±1} &e given. 
Then we have 

R{u+,v^){-eH+ + H^) = \/2M(^_(g_)^„^(g^))_^ . 

(g) From mxa © TnA4 to m2Ai © tTi2A2 • Let c, c G IH 6e given. Then we have 

R{H+, Mc,i)Mz,^i = H+ ■ Im(cc) - F_ • Im(?c) . 
Proof. All these formulas are easily derived from Equations ()20p . (I2ip and (I22p . □ 



We further prepare the classification by the following lemma, which exhibits how vn.^)^^ controls 
the structure of m';^^ (for v G {1,2} ). 

Lemma 5.7 Let v G {1,2} and suppose X^, G A'; put it := + for v = \ , it := — for 
V = 2. Then K := {c ^ ^\H±c G m' } is a sub-field of H with K ■ m'^ C m';^ and 
• m';^^ J-iR m';^^ . Consequently, we have n'^^^ G {0, 1, 3} and: 
(a) If ^^2A^ ~ ^ holds, then m'^^ is a totally real suhspace of mx^ . 

(h) If = 1 holds, say m^^^ = TRII±i with i G S(Im(IH)) , then m^^ is a totally complex 

suhspace of mx^ with respect to i . 
(c) If ri'2x^ = 3 holds, then vn!-^^ is a quaternionic suhspace of mx^ ■ 

Proof. We consider the case 1/ — 1; the case = 2 is proved analogously. Let us fix a basis (e+ , e_ ) adapted 
to A and let := {L+{A) n m') ; note that because of Equations (|23|l and (|24p . we have the splitting 

L'+=KH+®L'l with L'i ~ {m H+)^ n L'+ . (25) 

For any v G L'^ \ {0} , we consider the IR-linear suhspace 

:= {cem\vc& L'+} 

of IH ; clearly we have Kh^ ~ K . Below we will show that for any v,w £ L\ \ {0} 

{t;(e+),«;(e+)) =0 =^ ^ (26) 

holds; because of the splitting (|25p of L'^ into two non-zero, orthogonal summands it follows that does not 
depend on t; G 1/'+ \ {0} , and therefore we then have 

"iv e L'+ \ {0} : Ky^K . (27) 
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5 The classification of tlie Lie triple systems in G2(S1 ) 



For the proof of (I26p . we let v,w G L\ \ {0} with {w(e+), uj(e+)) = and c G be given. Then we also have 
11 c £ m' by the definition of , and therefore, owing to the fact that m' is a Lie triple system, R{'w, v) {v c) G m' . 
Via Equation (|20p we calculate 

m' 9 R{w,v){v c) = w ■ ||t;(e+)||^ c ; 

#0 

this shows that w c £ m' and therefore c G A",!, holds. This proves the inclusion Kv C ; the opposite inclusion 
is shown in the same way. 

Next we show that for any v,w £ m'x-^ , 

{v{e+),w{e+)} & K (28) 

holds. In fact, we have H+,v,w G m' and therefore R{H+,v)w G m' ; using Equation (|20|l one calculates that 
R{H+,v)w = H+ ■ {v(e+),w{e+)) holds. Thus we have H+ ■ {v{e+),w{e+)) G m' and therefore (|28p holds. 

It is a consequence of (I27p that the IR-linear subspace of IH with 1 G A' is closed under multiplication, and 
is therefore a sub-field of IH . Hence we have either = IR, or K = span{l,i} = (D with some i G S(Im(IH)) , 
or K ^M. 

If = IR holds, we have n'2Xi = , and m'x-^ is totally real by (|28p . 

If K = span{l, i} holds with some i G §(Im(lH)) , we have n'2x^ ~ 1 , and m^^ is totally complex with respect 
to i by (HZll and (f28)) . 

If = IH holds, we have n2x^ = 3 , and m^^ is quaternionic by (|27|l . □ 

In the sequel, we divide the classification into the following cases, depending on the configu- 
ration of A' : 

(1) Ai,A2,A3,A4 e A', 

(2) Ai,A2GA',but A3,A4 0A', 

(3) either Ai or A2 , but not both, are elements of A' , 

(4) Ai,A2 A', A3,A4 G A', 

(5) Ai, A2 A' , either A3 or A4 , but not both, are elements of A' , 

(6) Ai,A2,A3,A4 A'. 

It follows from the invariance of the root system A' under the action of its Weyl group, that 
whenever we have Ai G A' or A2 G A' , the presence of either of the two roots A3 and A4 in 
A' implies the presence of the other. Therefore these six cases exhaust all possibilities for A' . 
We will now handle these cases separately. 

Case (1). We suppose Ai, A2, A3, A4 G A' . In particular, we have m'^^^ 7^ {0} , and therefore 
Equation (fT6ll shows that there exists J G 5a and a basis (e+,e_) adapted to {A, J) so that 
j^{e+^e-) ^ ^/^^ holds. We show that the following relations hold between root spaces of m' 
corresponding to roots from the same orbit of the action of the Weyl group of A' : 

< = ^«) (29) 



m 



A, - { '^-^ I c G H, Mi;+f -) G } (30) 
m2A2 = {dH^\d£ Im(H), dH+£ m'2x, } • (31) 

For (|29]) . Let w G m';^^ be given. We have H^, M[^^f~\w G m' , and therefore also m' B 

RiH.,M['^+f-^)w = -^Jiw+) (the equals sign marked (*) follows from Lemma 15.6( b)): in 
fact we have J{w+) G m' n mx^ = m'x^ . This shows the inclusion "D" in ([29]) . and the converse 
inclusion is shown in the same way. 

For ([50]) . Let c G IH with Mjf^f'^ G m';^^ be given, and let us fix tt> G m';;^^ with ||ii;(e4.)|| = 1 . 

We have H_,M^'^+f-\ {-w) G m' and therefore also m' 3 R{H^, M'f+f-\-w) = J{w)-c 
((*) again follows from Lemma 15.6( b)). hence V- := —J{w) ■ c G tTiAj Pi m' = m';;^ . With 
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:= w £ m'^_^ we have (f_ (e_), ■U-|-(e+)) = {■w{e+)c,w{e+)) = c, and therefore - because of 
u+,V-,H+ + e m' - m' 3 R{u+,V-){H+ + = V2M^l+'^-^ ((*) by Lemma ED^f)), 
hence M^^^'^~^ G n m' = m'^^ . This shows the inclusion "D" in ([30|) : the converse inclusion 
is again shown analogously. 

For dSIl)- We have M^^+f"^ G m';^^ and therefore, by Equation i^, also m['^-^'''-^ G m'^^^ . 
Therefore Lemma 15.6( e) shows that for any d G Im(]H) with dH^ G ITI2A1 ' have 
dH^ G ^'2X2 1 and vice versa. 

Let us now consider K := {c ^M\cH+ Gm'} = ]R©{(iG Im(]H) | G m2;,^ } of H ; 
we saw in Lemma 15.71 that X is a sub-field of H , and how K controls the structure of ttiai • 
Because of Equation (I3ip we in fact have 

MH± © m2A, = K-H± for u G {1, 2} (32) 

hence -R' also determines the structure of m.\^ in the way described in Lemma 15.71 

We will now show that K moreover "controls" the root spaces m'^^ and m'^^^ , more specifically, 
that we have 

^A. = { I c G } for I. G {3, 4} . (33) 

We prove this equation for v = 2>] for v = A the proof runs analogously. So let c G IH with 
Mjf^f^'^ G m^^ be given. Again we fix n_|- G m^^ with ||n-|_(e+)|| = 1 . Then we have on one 
hand J(?i+) G m';^^ by Equation (f29]) . on the other hand J(?i+) • c G m';!^^ by Lemma [5.6( b). 
Because of ff_,J(ii+) ■c,J{u+) G m' we conclude by Lemma [5.6r a) that c G m' , and 
therefore by Equation (j32p c € K holds. 

Conversely, let c G K be given. With u+ G m';^^ being as before, we then also have u+-c G m';;^^ 
by Lemma E21 and J(u+) G m';^^ by Equation ([^^ . Because of n+ • c, J{u^),H^ + if_ G m' it 
follows from Lemma lS. 6( f) that Mjf^^^'^ ^ ^As holds. This concludes the proof of Equation (j33p . 

Now we have 

m' = a©m^^©m^© m';,3©m';,^ © m';,^ © m';,^ 

= K-H+(BK-H. = K-J(H+)®K-J(H-) = J(m', ) 

ED ED HIJ 1 

= U®J{U) 

with U :=K-H+®K- J{H^) © m';^^ C L+{A) . 

By Lemma [5. 71 f7 is a either a quaternionic subspace (if n^^^ = 3 ), a totally complex subspace 
(if = 1 ), or a totally real subspace (if n'g;^^ = ) of Lj^{A) . This shows that - depending 
on which of these three cases holds - m' is either of the type (G2, (H, 2 + ^n'^^ )) , or of the type 
(G2,((D,2 + in'^^)) or of the type (G2, (K, 2 + n';, J) . 

Case (2). We now suppose Ai,A2 G A', but A3,A4 A' . As before. Lemma E7] shows 
that m^^ and m^^ are (individually) either quaternionic, totally complex, or totally real. More 
specifically, if we put 

K± ■={ceM\cH± Gm'} , 

then m^^ is invariant under multiplication with K± and satisfies {K±)^'^ ■ m^^ _L]r m^^ . 
However, because of the absence of the roots A3 and A4 in A' , there is no binding between K^^ 
and K- anymore. 
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From the absence of the roots A3 and A4 , a condition on the relative positions of m^^ and m^^ 
can be derived: Let u+ £ m\_^ and f_ G m';;^^ be given. We then have R{u^,v^){H^ + H^) £ 
(mA3©mA4)nm' = {0} and therefore = R{u+,v_){H++H_) = \/2 mJ+^^:} ^^^^^^^^ _^ (where 
the last equality sign follows from Lemma [5T6l ffl). hence (e_), M+(e+)) = 0. Thus we have 
shown 

Therefore we have 

m' = © m'sA, © m2A2 © m'^, © m'^^ = f/i © J{U2) 

with Ui := K+- H+®m\_^ C and U2 := J{K^ ■ C L+{A) . Moreover, we have 

Ui J- U2 , and Ui resp. U2 is a quaternionic, totally complex, or totally real space according to 
the isomorphy type of resp. K_ . Therefore m' is of type (P x P, (IKi, 1 + ^n'-^^), (IK2, 1 + 
^n'^^)) , where IKi resp. IK2 is P, C or H, according to the isomorphy type of resp. , 
and we put r^, := dim]R(lK,y) G {1, 2, 4} . 

Case (3). We suppose that one, but not both, of the roots Ai and A2 is a member of A'; 
without loss of generality we may suppose Ai G A' and A2 A' . Because A' is invariant under 
its Weyl transformation group, we then also have A3, A4 A' . 

Let us again consider the sub- field K := {c £ ]H| ci7+ G m'} of H and choose IK G 
{P, (D, H} according to the isomorphy type of K , then according to Lemma [5.71 m^^ is of HP- 
type (K, i n'^^) with r := dimK(K) , hence m'^^ is of HP-type n := (K, 1 + i n'^^) . 
Moreover Pif_©m'2;^^ is of HP-type r2 , which is (P, 1) , (€,2), (S^) or (H, 1) , according 
to whether n^x^ is , 1 , 2 or 3 , respectively. Thus we have 

m' = © m2Ai ©m2A2 © m'A, = C/i © J{U2) 

=K-H+®U-H- 

with Ui := K-H+®m'x^ C L+{A) and U2 := J{M- H^em'^^^) C L+{A) . We have Ui ± J{U2) , 
and Ui resp. U2 is of HP-type ri resp. T2 ■ Therefore m' is of type (P x P,ri,r2). 

Case (4). Let us next consider the case Ai,A2 A', A3,A4 G A'. Similarly as in case (1), 
there exists J G 5a and a basis (e+,e_) adapted to (A, J) so that M^^^'"* G m';^^ holds. We 
now consider the P-linear subspaces 

Ca, := { c G H I Mi;+f G m'A,^ } C H for G {3, 4} 
and i:>2A, := { d G Im(H) \dH±£ m'2x, } C Im(H) for u G {1, 2} . 

(Unlike the similarly defined subspaces in previous cases, they are not generally sub-fields of 
H.) We have 1 G Caj . 

From the fact that m' is a Lie triple system, we derive the following inclusions via Lemma [5. 6 1 

Cas • -D2A1 , -D2A2 • C'as C Ca4 and ■ D2\^ , -D2A2 • CA4 C ; (34) 

Im(CA3 ■Cx,)C D2X, and lm{Cx, ■ Cx,) C D2X, ■ (35) 

Indeed, for the first inclusion of (fM|l . let c G and d G -D2A1 be given. By definition, we then 
have M^'^+f-\ dH+ G m' , and therefore also m' 9 R{H+,d H+)M^'^+f-^ = M^_!+J-^ (where 
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the equals sign marked (*) follows from Lemma IS^ d)). hence Mj:^'\'^~^ G H m' = m';^^ and 
therefore cd G C\_^ . The other inclusions of ()34p are shown similarly. 

For the first inclusion of (f35|) . let c E Cx^ and c G Cx^ be given. Because Cx^ is an IR-linear 
subspace of H with 1 G C^g , it is invariant under quaternionic conjugation, and hence we also 
have c S Cxj, ■ It follows from Lemma IS.GI fg) that -D2A1 3 Im(c • c) = — Im(c • c) and hence 
Lxl(c- c) G D2X1 holds. This shows the first inclusion of (jSSp : the second inclusion is shown in 
the same way. 

Because of 1 G C^g we derive from D2x„ C (7^4 , and from ([55]) : Im(CA4) -^2A^ • 

Because of these inclusions and D2x^ C Im(]H) , we have D2x^ C CA4 H Im(IH) C Im(CA4) 
D2x^ ■ In this way we conclude 

D2X^ = D2X, = Cx, n Im(H) = Im(CA4) • (36) 

It follows that we have 

either Cx, = D2x,, or C^^ = IR © Z^sA. ■ (37) 

We have n'^y^^ = (l\m.[D2x^) ■, and therefore by (f5H|) . 'n'2y^_^ = n-'2X2 ~- ^2 £ {0, ...,3}. To 
finish off the present case of the classification, we now consider the four possible values for 
separately. 

First suppose = , and hence D2x^ = {0} . By (f371) and the fact that A4 G A' holds, we 
therefore have CA4 = IR. Because we thus have in particular 1 G Cx^ , (1351) shows Im(CA3) 
-D2A1 = {0} , hence Cx-^ = IR . Thus we have 

m' = a © m';,3 © m';,^ = © IRF_ © IRM^^+f © TRMi^+'^-^ = U® J{U) 

=W{.J{H+)®^J{H-) 

with the subspace U := ®JRJ{H_) of L+{A) of HP-type (IR, 2) . Thus m' is of type 

(G2,(IR,2)). 

Now suppose 77.2 = 1 . Then there exists i G S(Im(IH)) with -D2A1 ''='' D2X2 = IRi , and by (f37|) 
we have either Ca4 = IRz or Ca4 = IR©IRi . In either case we have Im(CA3 " ^^4) ^2X1 = IRi 
by ([35]) , and therefore Cx^ • Cx^ C IR © IR z . Because of i G Ca4 , the latter inclusion implies 
Caj C IR©IRi ; because of 1 G Cx^ , we in fact have either Cx-^ = IR or Cx^ = IR©IRi . Because 
the dimensions of Cx^ and Ca4 are equal (the roots A3 and A4 correspond to each other under 
the Weyl transformation induced by 2Ai G A', and have therefore the same multiplicity), we 
have either Cx^ = Cx^ = IR © IR z , or Cx^ = IR and CA4 = IR « . 

If the former case holds, we have 

m' = spaniR{//+, H^,iH+,i i/^, M{;^+f il^.-'l'''^ ''"^ ^S^"'^} = U® J{U) 

with the subspace U := (C H+ © C J(i?_) of L+{A) of HP-type ((D,2) . Hence m' then is of 
type (G2,(C,2)). 

Otherwise we have Cx^ = IR and CA4 = IR i , and therefore 

m' = spaniR{i/+, H^,iH+,iH^, Mi'^+f-\ M^^+''-'^} , 

hence m' is the IR-ortho-complement of spanj^lMj^^-^'*^"-*, M^^j^''^"-'} = spanj^jw, f i} with v := 
Mj;^+f-^ in Ue J{U) . We have ip{v) = f , and therefore m' is of type (Q3) . 
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Next suppose n2 = 2 . Then there exists a canonical basis {i,j,k) of Im(]H) so that I?2Ai = 
D2\2 = Mi e IRj holds. By ([37]) we have either Cx^ = Mi ®JRj or Cx^ = MeMi ® Mj . 
In either case, we have Cx^ D Cx^ • D2X1 D IR © IRA; by (pl|) . Assume that we had Cx^ = 
IR© IRi © IR j . Then we would have k = l-k ^ Im(CA3 ' ^"^4) , and therefore k £ D2X1 by (f35D . 
a contradiction. Therefore we have = IRi © IRj , and thus because of dimCx^ = dim (7^4 , 
= ]R © IR A: . Thus we have 

This shows that we have m' = {^oX\X£ sp{V') } , where the H-linear isometry ^ : V ^ V 
is given by <&(e+) = k • ^^+(6+) and $(e_) = k ■ i/_(e_) . Therefore m' is of type (SP2) . 

Finally suppose n'g = 3 . Then we have D2x^ = Im(lH) , hence Im(IH) C (7^4 by ([57|) . 
and therefore by ([MI): Cx^ D Cx^ ■ -D2A1 D Im(H) • Im(H) = H, i.e. Cx^ = H, and thus 
also Ca4 D • -D2A1 = m • Im(]H) = H , i.e. Ca4 = H . Thus we have m\ = mx for 
A G {A3, A4, 2Ai, 2A2} , and therefore 

m' = affim2Ai®m^© m'A3®m'A^ = U®J{U) 

with the subspace U ■.= MH+ © H J(F_) of L+{A) of HP-type (H, 2) . Thus m' is of type 
(G2,(H,2)). 

Case (5). Here we suppose Ai,A2 A' and that either, but not both, of A3 and A4 is 
a member of A' ; we may suppose without loss of generality that A4 E A' , A3 A' holds. 
Because of the invariance of A' under its Weyl transformation group, we have 2Ai,2A2 A', 
and therefore m' = a © m'^^^ . It follows that m' is of type {E^ x S^, 1 + n'^^ . 

Case (6). Finally, we suppose Ai,A2,A3,A4 A', and therefore we have m' = a © m2;^^ © 
= C/i © J{U2) with Ui := © C and U2 := J(IRi^- © m'^^^^) C . 

We have Ui ± U2 and is of HP-type r^. , which is (IR, 1) , (C, 1) , (S^) or (H, 1) according 
to whether 712;^^ is , 1 , 2 or 3 , respectively. Consequently m' is of type (IP x P, ri, r2) . 

The concludes the classification for the case of rank 2. 
5.2 The case of rank 1 

We now let a Lie triple system m' of m with rk(m') = 1 be given. If dim(m') = 1 holds, then 
we have m' = IRi? with H G S(m') , and therefore m' then is of type (Geo, 99 = <f{H)) . Thus 
we may suppose dim(m') > 2 in the sequel. 

Because m' is of rank 1, any two unit vectors of m' are congruent under the isotropy ac- 
tion of G2(y' © V) . Therefore all vectors in m' \ {0} have the same characteristic angle (see 
Proposition H?!]) ipQ G [0, f ] . 

We fix a unit vector H G S(m') , then a' := IRi? is a Cartan subalgebra of m' . We choose a 
Cartan subalgebra a of m so that 0' = a Pi m' holds. (Such Cartan subalgebras exist, as was 
discussed in Section [2j In fact, for (pQ {0, ^} , is unique.) Because of dim(m') > rk(m') , we 
have A' := A(m', a') 7^ . Consider a G A' . a is either elementary or composite in the sense 
of Definition 12.21 Proposition 12.31 shows that if a is elementary, there exists A G A := A(m,a) 
with a'' G 0' and therefore '^{H) = ^{)^) ; if a is composite, there exist A,^ G A with A 7^ /x 
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5 The classification of tlie Lie triple systems in G2(IH"'~'~'^) 

and — fi^ being orthogonal to a' , and therefore (p{H) = ip{X^ — fi^) (note that if v, v' G ci\{0} 
are orthogonal to each other, we have (p{v) = (p{v') ). We have 

^(A«) = ipiXl) = ip{2X{) = ^(2A«) = 0, ^(Xl) = ^(Xl) = f 

and 

VA, /i G A, A / /X : ip{X^ - n^) G {0, arctan(i), arctan(i), f } . 
Thus we see that in any case 

ifo = ip{H) G {0, arctan(i), arctan(i), ^} 

holds. Below we will handle the cases corresponding to these four possible values of (po separately. 
In preparation to their treatment, we note that by Proposition 12.1 I f a) we have 

A' c { X{H) ao I A G A, X{H) / } (38) 

with the linear form uq : a! ^ M, tH ^ t , and 

m' = a'e (39) 

aeA^ 

with 

Vq G A' : = hxa I n m' . (40) 




We also note that by Proposition I4.1l fb) there exists A G 21 and an orthonormal basis 
{H+,H^) of with H± G L±{A) and H+{V'^{A)) ± H^{VL{A)) so that 

H = cos((/9o) H+ + sin((^o) H_ (41) 

holds. 

The case (po = . In this case we have H = by Equation (j4ip . and therefore 

Xi{H) = X^{H)=Xa{H) = 1, 2Xi{H) = 2, X2{H) = 2X2{H) = . 

If we consider the linear form a : a' — > IR, tH ^ t , we therefore have A' C {±a, ±2a} by 
Equation (f38l) . and 

m' = a' e m'^ © (42) 

with 

:=(mAi ©mA3©mA4) n m' C {v e L+{A)\v{V;{A)) ± H+{Vi{A))} (BMJ{H+) 
(where we fix J G 5a ) and 

i^2a := "^2Ai nm' C Im(IH)i7+ 

by Equations (15^ and (liUll . 

Let V G m'o. be given, say v = v+ + cJ{H+) with v+ G L+{A) , v+{Vl{A)) _L H+{Vl{A)) and 
c G IH . We fix a basis (e+, e_) adapted to {A, J) , then we calculate by means of Equations (I20p 
and dni): 

ii(i/+, r;)T; = R{H+,v+)v + i2(i/+, c J(i?+))t; = H+ {\\vie+)f + jcp) - 2 J(r;) • c . 
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5 The classification of tlie Lie triple systems in G2(IH"'~'~'^) 

Because m' is a Lie triple system, it follows that J{v) • c G m' holds. However Equation (jl2]) 
shows that J{v) ■ c is also orthogonal to m' . Hence we have J{v) ■ c = and therefore either 
V = or c = 0. Thus we have shown m'^ C {v e Lj^{A)\ {v{e+), H+{e+)) = 0} UMJ{H+); 
because m'^, is a linear space, it follows that 

either m'^ C {v e L+{A) \ {v{e+), H+{e+)) = 0} or m'„ C MJ{H+) 

holds. We now handle these two possibilities separately. 

First suppose that C {v e ^4.(^4)1 {v{e+), H^{e+)) = 0} and therefore m' C L-^-{A) 
holds. L+{A) itself is a Lie triple system (of type (P, f = 0, (H, n)) ) in m , and Equation ([20]) 
shows that the restriction of the curvature tensor R of G2{V' © V) to L^{A) is the curvature 
tensor of the quaternion projective space HP"' . m' also is a Lie triple system if regarded as a 
subspace of {A) , its position is therefore determined by the known classification of the totally 
geodesic submanifolds of HP" . Therefore there exists a HP-type r so that m' is of HP-type 
r in L-|_(A) , and therefore of type (P, 93 = 0, r) in m . 

Now suppose that m'^, C MJ{H^) and therefore m' C Hi?+ © MJ{H^) =: m' holds. Again 
in' itself is a Lie triple system in m, namely of type (G2,(H, 1)), and the restriction of R 
to in' is the curvature tensor of G2(H^) = HP^ . By the same argument as in the preceding 
case, there exists a HP-type r so that m' is of type r in in . If r = (IK, 2) holds with 
IK G {]R,C,H}, then m' is of type (G2,(]K,1)); if r = (K, 1) or r = (S^) holds, then m' is 
of type (IP, ^ = 0, r) . 

The case (fo = arctan(|) . In this case, we have by Equation ()4ip 

^ = ;^^+ + ;^^- (43) 



and therefore 

Ai(i?) = ^ , HH) = ^ , HH) = ^ , X,iH) = ^ , 2X,iH) = ^ , 2HH) = ^ . 

Because there does not exist a root A G A with A" G a' , Proposition I2.3l fa) shows that every 
root of A' is composite in the sense of Definition 12.21 Therefore we have A' = {±a} with the 
linear form a : 0' ^ IR, tH t , and by Equations (f39]) and ([lOl) we have 

m' = a' © m'„ 

with 

K ■= (mA4®m2A2) n m' . (44) 

We have = ^ ■ H = ^ + ^ = ^ xl + ^ (2X2^ , and therefore Proposition El shows 

that there exists a IR-linear subspace C C H and an IR-linear isometry $ : C ^ Im(H) so 
that 

< = { ''^-^ + $(c) H^\ceC} (45) 

holds, herein (e+,e_) is any basis adapted to A; because of Equation (fT6l) the basis (e+,e_) 
can be chosen in such a way that we have 1 G C . 

In the case n'^ = 1 this already shows that m' = spaii^{H, m[^^''^~'^ + ^{1) H^} is of 
type (P, (f = arctan(i), 2) . 
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5 The classification of tlie Lie triple systems in G2(IH"'~'~'^) 

So we now suppose dimC = > 2 and let ci,C2 € C be given. By Equation (fl5]) we have 
:= M^^'Y"'^ + \fl^ic)H- G m'„ for 1/ G {1,2} . Using Equations (l20]) . (|2T]) and (f22]) we 



^c^,l ^ Y 3 

calculate R{H, vi)v2 , which is again an element of m' because m' is a Lie triple system: 

R{H,v,)v, = I Re(crc2)F + -lgM(r+^-)_^(^^)^^ _^ . (46) 

Because mx^ is orthogonal to m' , the mAg-component of ([16|) . which is proportional to 
M^,'^''^~^ ^, s -, , vanishes, and thus we have shown 

Vci,C2 G C : $(C2) • ci = $(ci) • C2 . (47) 

By specializing ci = 1 in this equation, we obtain in particular 

Vc G C : ^>(c) = $(1) • c . (48) 

It follows that the case > 3 does not occur. In fact, under the assumption > 3 there 
would exist a canonical basis {i,j,k) of Im(IH) so that G C holds. We would then 

have on one hand by Equation ()48|) : ^{j) = ^(1) ■ j , on the other hand by Equation ()47|) : 

^{j) = $(i) • j • = ^{i) • k ^(1) - i-k = —$(1) - j , and therefore <^(j) = , in contradiction 
to the fact that $ : C ^ Im(IH) is a linear isometry. 

Therefore the only remaining case is that of = 2 . In this case, there exists j G S(Im(IH)) so 

that C = IR©IRj holds. Because Im(H) 9 $(j) ® $(l)-j holds, i := ^>(1) G S(Im(H)) must 
be orthogonal to j . Therefore k) with k := ij is a canonical basis of Im(IH) , and we have 

$(j) # $(1) • i = /fc. Therefore m' = spanj^ji/, Mi^'+'^-^ + ^JliH_, M^'^+'^-^ + ^kH_} is 
of type (S, (/? = arctan(i), 3) . 

The case (fo = arctan(|) . In this case, we have by Equation (j41|) 
and therefore 

X,{H) = ^ , A2(i7) = ^ , A3(i^) = ^ , A4(F) = ^ , 2X,{H) = ^ , 2HH) = ^ . 

Because there does not exist a root A G A with G a' , Proposition I2.3f a) shows that every 
root of A' is composite in the sense of Definition 12. 2i It follows that we have A' C {ita, ib2a} 
with the linear form a : a' ^ IR, tH -^t and by Equations (j39p and ()40p we have 



m' = a' © m'^ © m'a^ (50) 



with 



m 



:= (iTiAa ©mA4) n m' and := (hxai ©m2A2) n m' . (51) 

We have J = -^H = IH+ + \H^ = | A^ + | A| . By Proposition [221 it follows that for 
any basis (e+,e_) adapted to A there exists an IR-linear subspace C C IH and an IR-linear 
isometry <I> : C ^ rriAa so that 

m'. = {Mi;+'^-) + y|$(c)|cGC} (52) 
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5 The classification of tlie Lie triple systems in G2(IH"'~'~ ) 



holds, and that we have n'^, < 4 . If C 7^ {0} holds, the basis (e+,e_) adapted to A can be 
chosen in such a way that 1 G C holds. 

Similarly, we have (2a)« = | i7+ + | = ^ (2A2)* + t -^1 • By Proposition El it follows that 
there exists an IR-linear subspace D C Im(lH) and an IR-linear isometry $ : D — > m\-^ so that 

= {dH^ + 2^{d)\d e D} (53) 

holds, and that we have < 3 . 

Let ci,C2 S C and di,d2 £ D be given; by Equation (f52]) resp. (f53]) we then have 



:= M^l+f-^ + $(c^) G and := d^H^ + 2 $(d^) G m'a^ 

for 1/ G {1,2}. Via Equations ()20p . (I21|) and (I22|) we then calculate various instances of the 
curvature tensor; all the resulting vectors are again elements of m' by the fact that m' is a Lie 
triple system: 

V5R{vi,V2)H = -3if_ • Im(($(ci), $(02))) + V3J{^{ci) 02 - $(02) ci) (54) 
VhR{H, vi)vi = — y|$(ci)di + V2 J($(di))cr 

+ ^"^ ^^^J-I.(ci),5{di)> , 1 + ^^V*{ci),5(di)> , -1 + ^^^dr ci , -1 i^^i 

V5R{H,vi)v2 = 8H+ ■ {^{di),^{d2)) - ■ Re(di ^2) (56) 

ii(t;i, t^2)?^l = • ^/3 (cI ( J$(C2), $(di)) - ( J$(ci), $(di))) 

+ i7_-(lm(cic^)(ii -di Im(ci c^) + 3 di Im(($(c2), $(ci)))) 

+ 2 $(d) Im(c^ci) + 3 J($(ci)) (J$(C2), $(di)) - 3 J($(c2)) (J$(ci), $(di)) . 

(57) 

We will now use these equations to derive results concerning the structure of the data (C, <I>) 
describing m'^ , the structure of the data {D, $) describing m'2a , and the relations between these 
two sets of data. 

Because Tn2Ai is orthogonal to m' by Equations (fSUj) and (f^T]) . the m2Ai-component of the 
element (|56|) of m' , which is proportional to ■ lm{{^(di), ^{d2))) , vanishes. This shows that 
$(£)) is a totally real subspace of m\-^ . It follows that a' © m2Q, is a Lie triple system of type 
(iP,ip = arctan(^),r) , where the HP-type r is (IR, 1) , ((D, 1) , (§3) or (H, 1) , according to 
whether ngQ, is , 1 , 2 or 3 , respectively. Therefore if = holds, then already m' is of 
that type. 

In the sequel we thus suppose n'^ > 1 ■ Hence we have C 7^ {0} and therefore, by our choice 
of the basis (e+,e_) adapted to A, IgC 

Because is orthogonal to m' , the mAg-component of ([55]) . which equals 

VSM^'r+f j^Mjf+/-}^ , vanishes. Hence we have ( J$(ci), $((ii)) = — 75 (ii -ci . More- 

over the (mA4 © mA2)-component of (fSSl) . which equals M^^t'^"^ ~ — y/3/2 <I>(ci) di + 

a/2 J($((ii)) ci , is a member of (mA4 © iriAj) H m' = ; it follows by Equation ([^ that 

-^di-ci = {J^ci)Mdi)) G C (58) 

and 

$(dici) = $(ci)di-^j($(di))cr (59) 
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5 The classification of tlie Lie triple systems in G2(IH"'~'~'^) 

holds. ()58p shows in particular that we have 

D-C CC ; (60) 

because of 1 G C it follows that 

Dec (61) 

holds. 

Next we note that (f5il) is a member of (m2A2 © iriAi ) H m' = m'g^ ; it follows by Equation ((53]) 
that (-3) Im(($(ci),$(c2))) G i:* and that 

$((-3) Im(($(ci),$(c2)))) = iV3J($(ci)c2-$(c2)ci) , 

Im(($(ci),$(c2))) eZ) (62) 
$(c2)ci = $(ci)c2-2^/3J($(Im($(ci),$(c2)))) (63) 



hence 



and 



holds. 

A final relation is obtained by considering the m2A2 -component of ([57]) : we see that for any 
ci , C2 £ C and di £ D we have 

Im( Im(ci c^) di - di Im(cic^) + 3di Im(($(c2), $(ci))) ) e D . (64) 

Now we use these relations to show that m' is indeed of a type of the form (IP, ip = 
arctan(i),(IK,2)) . 

First suppose = 1 . Then we have C = IR and therefore D = {0} by ()61|) . Hence 
Equations dSO]) and ([52]) show that m' is spanned by H and + ^J^^{1) ■ It follows 

that m' is of type (P, ip = arctan(i), (IR, 2)) . 

Thus we now suppose > 2 . In this situation we have 112^ > 1 : Assume to the contrary 
that 722^ = and therefore D = {0} holds. Because of > 2 there exists « E C H S(Im(IH)) . 
We would have Im(($(l), 4>(z))) = by ([62|), and therefore <I>(i) = $(1) • i by Equation (f63l) . 
But using the latter relation we now calculate (<5(1), <^(i)) = (<i>(l), <I>(1) i) = ||<I>(l)|p ■ i = i, 
hence i £ D hy ()62p in contradiction to our assumption. 

If = 2 holds, we have C = IR© IRz with some i € §(Im(IH)) and then D = lRi because 
of f22Q > 1 and (f6T]) . We then have (J$(l),$(i)) = by Equation (f58]) . and therefore 

there exists tuq G S(mA2) with {wo,^{i)) = so that 



holds. Further, we have by Equation (applied with ci = 1 , di = i ) 

This shows that = spann^{M|^j+'''-^ - + wq , Mj;^^+'''-^ - -^Ji^) + wq i} is of the 

form of m'^ defined in the description of the type (iP,(p = arctan(^), (C,2)) . a' © va'2a , the 
ortho-complement of in m' , is of type (P, (p = arctan(i), (C, 1)) because of n'g^ = 1 . Hence 
m' is of type (P, ip = arctan(^), ((D, 2)) . 
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Thus we now suppose > 3 . We will then show that the multiplicities of both a and 2a 
are already maximal, i.e. that = 4 and n2a' = 3 holds; it will follow therefrom that m' is of 
type (F,(/5 = arctan(i), (H,2)) . 

We know by the preceding arguments that 122^ > 1 holds, therefore there exists i £ S(Im(lH)) 
so that IRi C D holds. We have D C C by (I60p . so we can extend i to a canonical basis k) 
of Im(lH) so that lR©IRie]Rj C C holds. By ([60]) we then also have C D i- (lR©lRi©lR j) = 
IR i e IR e IR A; and therefore C = H , hence = 4 . 

Assume that n2a' < 3 holds. Then there would exist some q G S(Im(IH)) with q _L]r D . 
Because of i G D we would in particular have q _L]r i and therefore qi = iq , moreover 
-D C IRi © IRgz . By applying with ci := q £ C , C2 := 1 G C and di := i £ D , we see that 

Im( Im(gT)i - i Im(gT) +3i Im(($(l),^>(g))) ) = 2qi + 3 lm{i lm{{<P{l),<^{q)))) (65) 

^ V ' 

(*) 

is a member D . We have (<I>(1), e D C Mi^Mqi by ([62]), hence i {^{l),^{q)) £ 

IR©IRg and therefore the term marked (*) in (I65p lies in 1R(7. Because (I65p . as a member of 
D , is IR-perpendicular to q , it follows that the term marked (*) in fact vanishes, and thus we 
see that qi £ D holds. Now we apply (I64p again, this time with ci := i £ C , C2 ■= 1 £ C and 
d := qi £ D , to see that 

Im( Im{iT)qi-qilm{iT)+3qilm{{<^{l),<^>{i))) ) = 2 g + 3 Im( Im(($(l), $(i))) ) (66) 

is a member of D . We now have by Equation §2i): $(i) = 2 ^3 J'l'(Im($(l), $(i))) 

and therefore 

= ($(1),1>(1)^) -2^/3(cI>(l), J$(Im(cD(l),cI>(i)))> 
= i + 2V3(j$(l), $(Im($(l), $(?)))> 
^i-2Im((«>(l),$(i))) . 

From this calculation, we first conclude (<I>(1), <I>(i)) £ Im(lH) and then ($(1), <I>(i)) = ji. So 
we see that the element (I66p of D in fact equals q . Thus we have shown q £ D , in contradiction 
to our assumption. Therefore we have = 3 and hence D = Im(IH) . 
Now let c G IH be given. Then we have for any d G IH by Equation (I58p 

{J{^d)),^c)) = -j=^cd. 

If k) is any canonical basis of Im(lH) , we therefore have 

«>(c) = -^{Ji^ii))ci + Ji^ij))cj + J{^ik))ck) +w' 

^ V ' 

(*) 

with some vector w' £ which is H-perpendicular to ^{D) . However, both $(c) and the 
vector marked (*) above are vectors of length |c| , whence w' = follows. Hence we have 

mL^{Mi7'-) + yi$(c)|cGlH} 

= { M^';+''-^ - j^{j{^i))ci + J{^j))cj + J{^k))ck) I cGH }. 
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This shows that is of the form of m'^ defined in the description of the type (P, ip = 
arctan(^), (H, 2)) . 0' © ^2a^ the ortho-complement of m'^ in m' , is of type (P,(p = 
arctan(^), (H, 1)) because of 112^ = 3 . Hence m' is of type (IP, tp = arctan(|), (H, 2)) . 

The case cpo = ^ . This case could be solved by similar calculations as in the other three 
cases. However, we here employ a different method, using the classification result due to Wolf 
already mentioned in the Introduction. 

Let M be the connected, complete, totally geodesic submanifold of ^2(1^'©^) with V' £ M 
and Tv'M = m' . By Proposition |13] M has the property that Ui n U2 = {0} holds for 
every Ui,U2 € M with Ui 7^ U2 ■ The totally geodesic submanifolds with this property have 
been classified in all Grassmannian manifolds by Wolf in |W1] and |W2] . and we now apply 
his classification to our situation. When reading the theorems cited below, it should be noted 
that the condition of isoclinicity occuring in them is for a totally geodesic submanifold M of 
G2iV' © V) equivalent to our property ( i/i n C/2 = {0} for every Ui,U2 G M with 1/1^1/2) 
by (W2], Theorem 2'. 

M is a symmetric space of rank 1 , and therefore either isometric to a sphere or to a projective 
space. 

If M is isometric to a sphere, then by |Wlj . Theorem 8 the dimension of M is at most 5 
and every such sphere is contained in a 5-dimensional one. By [Wlj, Theorem 7 any two such 
spheres of the same dimension are congruent to each other. The totally geodesic submanifolds 
corresponding to the type (S^, = f ) are isometric to spheres (see the investigation in Section Ej) 
of the type of the present case and therefore M is contained in such a sphere, hence m' is 
contained in a Lie triple system of type (§^,(/5 = j) . Therefore m' is of one of the types 
(P, = f , (P, 1)) , (P, = f , (C, 1)) , (P, = f , {S')) , (P, = f , (H, 1)) and (S^, ^ = f ) , 
depending on whether its dimension is 1 , 2 , 3 , 4 or 5 . 

Otherwise M is isometric to a projective space. |W2| . Lemma 7 shows that the Cayley 
projective plane does not occur. Therefore M is isometric to IKP^ for some IK E {P, C, H} 
and £ >2 . By |W2j , Theorem 3 we have i < ^ , and two submanifolds of the present type which 
are isometric to the same projective space are already congruent in G2iV' © V) . The explicit 
description of the tangent space of these totally geodesic submanifolds in |W2j . Proposition 1 
shows that the tangent space m' of M is of type (P, (p = j, (IK,£)) . □ 

6 Totally geodesic submanifolds of G2(IH"+^) 

Of course we want to know the geometry of the totally geodesic submanifolds which correspond 
to the various types of Lie triple systems of G2(IH"'~''^) . Their local isometry type can be read 
off their root systems, which have been constructed in the proof of Theorem 15.31 However, to 
determine the global isometry type, and the position of the submanifolds in G2(IH"~''^) (for 
example, by explicitly describing totally geodesic embeddings), one has to investigate the global 
structure for each type separately. 

The global isometry types of the various totally geodesic submanifolds, which result from 
the considerations of the present section, are given in the following table. Herein, we ascribe 
the type of a Lie triple system also to the corresponding totally geodesic submanifold (or to 
a corresponding totally geodesic embedding). For ^ G IN and r > we denote by Sf the 
^-dimensional sphere of radius r , and for x > we denote by PP^ , ^^i^ and PP^ the 
respective projective spaces, their metric being scaled in such a way that the minimal sectional 
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curvature is x . ( IRP^ is then of constant sectional curvature x and CP^ is of constant 
holomorphic sectional curvature 4x . The totally geodesic submanifolds of HP^ are MP^ , 
(DPi , MPi and with £'<£.) 



type 


corresponding global isometry type 


(Geo, 97 = t) 


P or §1 


(P,(/p = 0, (]K,£)) 


KPf 


(P, 99 — U, (£i> jj 


^r=l/2 


— aicT^aii^ 2 A 








(F,(/7 = arctan(i),(]K,^)) 


KPf/5 


(P,(/9 = arctan(i),(S3)) 


■^3 


(P,(^ = f,(K,^)) 


KP^l/2 


(P,V^ = f,(S3)) 


^r=l/v^ 






(G2,(]K,^)) 

(PxP,(Ki,£i),(K2,^2)) 

(P xP, (1K,£),(S3)) 

(PXP,(S3),(S3)) 
(§1 X §5^^) 
(SP2) 

(Q3) 


G2(K^+2) 

KiP^i X KsPf^ 
KPl X S3^^/2 

^r=l/2 ^ ^r=l/2 

(SL1/V2 X s;.i/v2)/i±^d} 

Sp(2) 
G+(P5) 



Remark 6.1 It is an interesting observation that the geodesic diameter of certain of the to- 
tally geodesic submanifolds of G2(]H"'"'"^) is strictly larger than the geodesic diameter § \/2 
of G2{M^^'^) itself: The geodesic diameter of the spheres corresponding to the type (S,(/5 = 
arctan(i),£) equals | \/lO 1 and the geodesic diameter of the projective spaces corresponding to 
the types (P,(/9 = arctan(i),r) equals ^ \/5. 

As mentioned above, the correctness of the local isometry types (in particular, the correctness 
of the given radii and curvatures) is easily seen by inspecting the root systems of the various 
Lie triple systems. To justify the global isometry type, and also to gain more insight into the 
geometry of some of the types of totally geodesic submanifolds, we now study the individual 
types separately. Because any two Lie triple systems (and therefore also any two totally geodesic 
submanifolds) of the same type are congruent under the isotropy action of G2(]H"^^) , it suffices 
to provide one example of totally geodesic embedding per type (where the "type" of a totally 
geodesic submanifold as used below is the same as the type defined in Theorem 15. 3p . 

Type (G2,t) . The canonical embedding ]H^~^^ ^ H""*"-^ induces a totally geodesic isometric 
embedding G2(H^+2) ^ G2(H"+2) of type (G2,(H,£)). Moreover for IK G {P, C} , let i : 
^ ]H"+2 be the canonical embedding, then G2(]K^+2) ^ G2(H"+2), U ^ s^s.n^{L{U)) 
is a totally geodesic isometric embedding of type (G2, (]K,£)) . 

Types (IP, = 0, r) and (IP x IP, n, T2) . If IH"^^ = Fi ^2 is an orthogonal splitting 
into symplectic subspaces of dimension + 1 (where > , ^1 + ^2 = + 2 ) , then the 
map 

/ : HPi(Fi) X HPi(y2) ^ G2(H"+2), (pi,p2) ^ Pi (BP2 
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is an isometric, totally geodesic embedding. It is of type (P, f = 0, (H, n)) for £2 = , of type 
(IP X P, (H,£i),(H,^2)) for 4,^2 > 1- If now ti,T2 are HP-types with dim(r^) < , then 
there exist totally geodesic submanifolds M^^ of IHPi(V^) , and the restriction of / to Mi x M2 
is a totally geodesic embedding into G2(IH""'"^) of type (iP,ip = 0,ri) resp. (P x P,ri,r2) . 

Note that the Lie triple systems of type (P x P, (P, 1), (P, 1)) are the Cartan subalgebras of 
m , and therefore the totally geodesic submanifolds of G2(IH"^^) of that type are the maximal 
tori of G2(H"+2) . xhey are therefore isometric to PP} x PP} ^ S,Li/2 x ^=1/2 ■ 

Because any two points of G2(IH"~''^) are connected by a minimal geodesic, which runs in a 
maximal torus, the geodesic diameter of G2(H"'*''^) equals the geodesic diameter of its maximal 
tori, i.e. 7r/\/2. 

Type (Geo, (p = t) . The totally geodesic submanifolds of this type are, of course, the traces of 
geodesies 7 : P ^ G2(H"+^) with ip{^{0)) = t. 7 runs within a maximal torus of G2(H"' ) , 
the latter being isometric to §^^^^^2 ^ ^r=i/2 preceding result. Thus it follows from the 

well-known behavior of the geodesies on the torus that if tan(t) is irrational, then 7 is injective, 
and 7(P) is a non-embedded totally geodesic submanifold which is isometric to P and which is 
dense in the maximal torus to which 7(0) is tangential. On the other hand, if tan(t) is rational, 
say tan(t) = with ^1,^2 £ IN relatively prime (in the case t = we put £1 := , £2 ■= 1), 
then 7 is periodic with period L := tt , 7|[0,L) is injective, and therefore 7(P) is 

isometric to 1 , 

Type (S, </? = arctan(|),£) . The totally geodesic submanifolds M of this type are of di- 
mension £ and of constant curvature | = with r := ^^/lO. Therefore they are isometric 
either to or to PP^^^,2 . To distinguish between these two cases, we calculate the length of 
a geodesic tangential to M : The preceding discussion of the type (Geo, (f = t) shows that the 
the submanifolds of type (Geo, ip = arctan(|)) are circles of radius ^ • + 3'^ = r . Therefore 
M is isometric to §^ ^ 



-2 n/io 



The spheres of type (S,ip = arctan(|),2) are related to the submanifolds of type (P,97 = 
arctan(|), (P, 2)) , see the discussion of this type in Section [7] below. 

Type (IP, (p = arctan(^), r) . We will describe the HP^ which is a maximal totally geodesic 
submanifold in G2(H'') of type (P,v' = arctan(^), (H, 2)) . The other types (P,(/7 = 
arctan(^),r) correspond to totally geodesic submanifolds of that HP^ of HP-type r; for 
the types r = ((D,2) and r = (P, 2) also see Section [71 

Let be a complex-6-dimensional unitary space, and r : ^ be an anti-unitary 
transformation (i.e. r is anti-linear and orthogonal with respect to the real inner product on 
W ) with = — idvi/ • Via r , W becomes a symplectic space of quaternionic dimension 3 ; we 
also have the corresponding symplectic group 

Sp{W, t):={B e SU(VF) \BoT = ToB}^ Sp(3) . 

Let us now consider the three-fold alternating product /\^ W of the complex linear space W ; 
this is a complex-20-dimensional unitary space. Note that every endomorphism f : W ^ W 
induces an endomorphism f^^^ : /\'^ W ^ /\^ W characterized by f^^\wi A W2 A W3) = f{wi) A 
f{w2) A f{w^) for all 'Wi,W2,w^ G W . r^^^ is an anti-unitary transformation on f^W with 
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(7-(3))2 _ _j(j^3^ gQ /\^ W becomes a quaternionic-lO-dimensional symplectic space via r^^^ . 
Sp(H^, r) acts on /\'^ W by sympleetie transformations via 

Now let {bi,b2,bs) be any symplectic basis of the symplectic space W and put 

a; := 61 A r(6i) + 62 A r(62) + 63 A r(63) G ^ > 

a; is non-zero and does not depend on the choice of the symplectic basis (61, 62, 63) . Because of 

the latter property, we have (cj) = UJ for every B G Sp(W, r) , and therefore the symplectic, 
quaternionic-7-dimensional subspace V := {W A cu)-^ of /\^ W is invariant under the action of 
Sv{W,t). 

We will construct the totally geodesic HP^ of type (IP, arctan(i), (H, 2)) in the quaternionic 
Grassmannian G2{V) = G^iM^) ■ For this, note that the action of Sp{W,T) = Sp(3) on V 
induces an action on G2{V) in the obvious way, and we will find an orbit M of this action 
which is totally geodesic and isomorphic to HP^ = Sp(3)/(Sp(2) x Sp(l)) . 

Fix an orthogonal splitting W = W'^ © of W into symplectic subspaces W'^ and 
of quaternionic dimension 2 resp. 1. Let (61,62) resp. (63) be any symplectic basis of 
resp. , and put 

7? := 61 A r(6i) + 62 A r(62) - 63 A ribs) e /\^V ; 

rj is non-zero and does not depend on the choice of the bases. We have U := W'^ Ar] E G2{V) . 

The isotropy group K of the Sp(VF, T)-action on G2{V) at the point U equals Sp(VF, r)2,i := 
{Be Sp{W,T) I B{W^) = W^}^ Sp(2) X Sp(l) . Therefore the orbit M C G2{V) of the said 
action through U is isomorphic to HP^ . Moreover, M is a totally geodesic submanifold of 

G2iV) of type (P, (p = arctan(^), (H, 2)) . 

Proof of the statements on K and M . For every B G Sp(H^, r)2,i we have B^^\rj) = rj and therefore 
Sp(VF, t)2,i C K holds. To show the converse inclusion, and also that the orbit M C G2iV) is totally geodesic, we 
first work on Lie algebra niveau. The Lie algebra of Sp(W^, t)2,i is sp{W, r)2,i ■.= {X e sp{W, r) \ X{W^) CW^} . 
Let any X G sp{W,T) which is orthogonal to sp{W,T)2.i with respect to the Killing form of sp(VK, r) be given, 
then we have X{W^) C and C Let 3- : Sp{W,t) Sp(V,t(^'), B ^ B^^>\V be the canonical 

embedding, and $l : sp{W,T) — » sp(V, r*^^^) its linearization. Then one can calculate that $l(X){7 C Z/"*"'^ and 
^LiX)U^^^ C U holds by using the explicit presentation of $i : 

VX € sp{W,t), wi, W2, W3 e : {^l{X))(wi A W2 A UI3) = Xwi A W2 A W3 + wi A Xw2 A UI3 + wi A W2 A Xws 
and the symplectic bases 

(61 A 62 A T 62 — 61 A 63 A T 63) , (62 A 61 A r 61 — 62 A 63 A T 63) 

of U resp. 

(63 A 61 A r 61 — 63 A 62 A r 62) , 61 A 62 A 63 , r 61 A 62 A 63 , 61 A r 62 A 63 , 61 A 62 A r 63 

of U^'^ . This shows that maps the ortho-complement m of sp{W,T)2,i in sp(VK, r) (with respect to the 
Killing form) into the ortho-complement p of 5p(L'', r*-^-') ® sp([/''"'^,T*^-') in sp{V,T^^^) (with respect to the 
Killing form). 

The decomposition sp{V,T^^'>) = (sp()7, r<^') sp([/^'^, r'^')) © p is the Cartan decomposition of sp{V,t'-^^) 
induced by the symmetric structure of G2{V) ; therefore the fact $i(Tn) C p has several consequences: First, the 
Lie algebra f of the isotropy group K is contained in sp(W^, t)2,i ; because we have already seen Sp(W, t)2,i C K , 
we in fact have t = sp(VF, r)2,i • Thus the neutral component of K equals Sp(VK, r)2,i . Therefore, second, the 
decomposition sp{W,T) = 6®m is a Caxtan decomposition of sp{W,T) , corresponding to the symmetric structure 
of ep2. Therefore the Sp(VF, r)-orbit M is a locally symmetric space, locally isometric to HP^ . Third, 
$L(nt) C p shows that M is a totally geodesic submanifold of the symmetric space G2{V) . Fourth, because M 
is therefore a globally symmetric space which is locally isometric to IHP^ , M is in fact globally isometric to HP^ 
(there do not exist any non- trivial symmetric covering maps below HP^ ). This finally shows the isotropy group 
K to be connected, and therefore to be equal to Sp(W,T)2,i . □ 
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Type (IP, (p = f , r) . Let r be a HP-type with dim(r) < f and let f : MxM ^ G2(H"+2) 
be the totally geodesic embedding of type (P x P, r, r) described above (so M is either a KP^ 
or S^=|/2 according to r ). Then the "diagonal map" M G2(]H""''^), p 1— > f{p,p) is a totally 
geodesic, isometric embedding of type (P, (/? = f , r) . 

Type (S^, = ^) . The totally geodesic submanifolds of this type are 5-dimensional, have 
sectional curvature 2 = ^ with ^ •= j and the geodesies starting tangential to it (they are 
of type (Geo, t = f ) ) have length vr • Vl^ + 12 = 27rr . It follows by the analogous argument as 
for the type (P, = arctan(i),£) that the submanifolds of type (S^,VJ = j) are isometric to 

Type (SP2) . The totally geodesic submanifolds of type (SP2) and (S^xS^,5) are reflective 
and complementary to each other in G2(IH^) , see the classification of reflective submanifolds in 
|Lej . There it is also stated that the submanifolds of type (SP2) are globally isometric to Sp(2) . 

We now give another geometric construction of the totally geodesic submanifolds of type (Sp2) 
in G2(]H^) ; this construction will also show again that these submanifolds are globally isometric 
to Sp(2) . 

For this we need some important geometric concepts introduced by Chen and Nagano (see 
|CN| and [C]), which are applicable to any Riemannian symmetric space M of compact type: 
Let p G M and Sp : M ^ M be the geodesic symmetry of M at p , then the connected 
components / {p} of the fixed point set of Sp are called polars of M (with respect to p), 
they are totally geodesic submanifolds of M . A pole of M is a polar which is a singleton. For 
pi,P2 € M , a point g G M is called a center point between pi and p2 , if there exists a geodesic 
joining pi to p2 so that q is the middle point on that geodesic. If p2 is a pole with respect to 
pi , we call the set C{pi,p2) of center points between pi and p2 the centrosome of pi and p2 ■ 
It is easy to see that it is invariant under the action of the isotropy group at pi (or p2 ) and that 
its connected components are totally geodesic submanifolds of M (see [C], Proposition 5.1). 

Now let (ei, . . . , 64) be a symplectic basis of H'* , U := spauj^jei, 62} G G2(IH^) , and K := 
{B G Sp{4) \B{U) = U} ^ Sp(2) X Sp(2) be the isotropy group of G2(H^) at U. Then 
U-^ = spaujfjjes, 64} is a pole to U (in fact, the only pole), U' := spaujjjjei + 63,62 + 64} = 
{ (ei, . . . , C4) G I ci = 63, C2 = 64 } is a center point between U and [/-*- , and the i^-orbit 
through U' is a connected component of the centrosome C{U, [/-*") , and therefore a totally 
geodesic submanifold of G2(IH^) . By explicitly calculating a tangent space of , one checks 
that A^ is of type (SP2) . The isotropy group of the action of K at U' equals the diagonal 
A{K) := {{B,B)\B G Sp(2) } of ^ Sp(2) x Sp(2) , and therefore A^ is isomorphic as 
homogeneous space to K/A{K) = Sp(2) . This confirms that the totally geodesic submanifolds 
of type (SP2) are globally isometric to Sp(2) . 

Type (§■*■ X . Let m' be a Lie triple system in m of type (S^ x S^,5) . By inspection 

of its root system, we see that the totally geodesic submanifold corresponding to m' is locally 
isometric to ^ There exists a unit vector vq G m' so that m" := (Puq)"'"''" is 

a Lie triple system of type {S^,^p = f ) ; iTi" corresponds to a totally geodesic submanifold of 
isometry type by the preceding consideration of that type. Moreover, if vi G m" is any 

unit vector, then IRvq © Pwi is a Cartan subalgebra of m; the totally geodesic submanifold 
corresponding to it is therefore a maximal torus, and hence isometric to Sj^-j^ x §J^^ by the 
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corresponding investigation above. It follows from these observations that the totally geodesic 

--I/V2 ^ K=l/V2^ 



submanifold corresponding to m' is isometric to , x , /-)/{±id} . 



Type (Qs) . Let M be a totally geodesic submanifold of G2(1H'^) of type (G2, (€,2)) , then 
M is as Riemannian symmetric space isomorphic to G2(C^) , as we saw in the treatment of the 
type (G2,t) . But G2(C^) is as Riemannian symmetric space isomorphic to the Grassmannian 
of oriented planes G^(IR^) , as can be seen for example by comparing the Dynkin diagrams of the 
two spaces, and noting that both are simply connected (the Lie group isomorphism underlying 
this isomorphy is SU(4) = Spin(6) ). The canonical embedding IR^ ^ IR^ therefore induces 
a totally geodesic embedding G2"(IR^) M ; seen as an embedding into G2(IH^) it is of type 

(Qs). 



7 Totally geodesic submanifolds in the complex 2-Grassmannian 

Because G2(C"'+^) is a totally geodesic submanifold of G2(]H"+^) (of type (G2, (C, n)) ) we can 
now easily determine the Lie triple systems resp. the totally geodesic submanifolds of G2(C"'"'"^) . 
All we need to do is to see which of the congruence classes of Lie triple systems in G2(1H"'^^) 
have members which are contained in a Lie triple system of type (G2, (C,n)) . In this way we 
obtain the result of the following theorem. Here we call a HP-type r a (DP-type, if it is either 
of the form r = (C,£) or of the form r = (IR, . 

G2(C"^^) carries both a SU(n + 2)-invariant Kahler structure J and a SU(n + 2)-invariant 
quaternionic Kahler structure 5- For a description of these structures, see [Bj. In the following 
theorem we also describe the position of the totally geodesic submanifolds of G2(C"'"'"^) with 
respect to these structures. 

Theorem 7.1 Let mi be a Lie triple system of m of type (G2,(C,n)), i.e. mi corresponds to 
G2((D"^^) . Let {0} 7^ m' be an JR-linear subspace of mi . Then m' is a Lie triple system of 
mi if and only if m' is of one of the following types: 

• (Geo, <^ = t) , where t e [0, f ] . 

• (IP, if = 0,t) , where r is the name of a (DF-type with dim(T) < n . 

• (S, 99 = arctan(|), 2) 

• (IP,v' = arctan(^),T) where r is the name of a (DP-type with dim(T) < 2 and n > 
dim(r) + w{t) 

• (IP, <^ = j,t) , where r is the name of a lUP-type (sic!) with dim(T) < ^ 

• (G2,r) , where r is the name of a (CP-type with dim(r) < n 

• (IP X P,ri,r2) , where ti and T2 are names of <CP-types with dim(ri) + dim(r2) < n 

• (§1 X S^,i) , where £<3 

• (Q3) 

In the following table, we give for each type of Lie triple system in G2(C"^'^) the (global) 
isometry type of the corresponding totally geodesic submanifolds, their position with respect to 
the complex structure J (complex, totally real or neither) and with respect to the quaternionic 
structure 5 (quaternionic, totally complex, totally real, or neither), and state if the Lie triple 
systems are maximal. 
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tvvc 


isometry type 


J -position 


"^-position 


maximal 


(Geo, ^ = t) 


P or §1 


totally real 


totally real 


no 


(P,yp = 0,(]R,£)) 




totally real 


totally real 


no 


(P,(/p = 0,(C,£)) 


CPf 


complex 


totally complex 


for i = n 


(S, ip = arctan(i), 2) 
(P,V3 = arctan(i),(]R,£)) 


r=VT0/2 


neither 
totally real 


neither 
totally real 


no 
no 


(P,V9 = arctan(i),((D,^)) 




neither 


neither 


if n = A: for £ = 2 


(P,^ = f,(]R,^)) 


PP^/2 


totally real 


totally real 


no 


(P,(/p = f,(C,£)) 


CPf/2 


totally real 


totally complex 


no 


(P,(/.= f,(S3)) 


r-1 /^/2 


totally real 


neither 


no 


(P,^ = 5,(H,^)) 


1/2 


totally real 


quaternionic 


for 2i = n 






totally real 


totally complex 


for i- = Ti 






complex 


quaternionic 


for i = n — 1 


(P X P, fP,^2)) 


PPf X PPf 


totally real 


totally real 


no 


(P X P,(P,£i),(C,^2)) 


PP^i X CP^ 

i 1 


neither 


neither 


no 


(PxP,(C,^l),(C,£2)) 


CP{i X CPi^ 


complex 


totally complex 


for £i + £2 = n 


(§1 X §5^^) 


(Si=i/v^ X S'.i/V2)/{±id} 


totally real 


neither 


if n = 2 : for £ = 3 


m 


G+(P5) 


complex 


neither 


if n = 2 



Proof. The only thing that is not immediately obvious from the classification of totally geodesic suhmanifolds 
in G2(IH""'"^) given in Theorem 15.31 is the fact that mi contains Lie triple systems of type (P, (p = j, (IH,^)) for 
every £ < ^ ■ To see this, one should use the alternative description of that type given in Remark 15.51 □ 

Remarks 7.2 (a) The type (P,'/' = arctan(^), (C, 2)) (isomorphic to CP^y^ , maximal in 
G2{G^) ) is not found in the "classification" of totally geodesic suhmanifolds of G2{G"'^^) 
in Table VIII of |CNj . It has never been described before, as far as I know. 
Moreover, the existence of the type (P,^ = arctan(^),2) , although not maximal in any 
G2{G^~^'^) (but rather in G2(P^) ), can not be deduced from that table; it corresponds to 
the type (A) of my classification of totally geodesic suhmanifolds in the complex quadric 
Q" ^ G+(P"+2) in [K]. 
(b) We again encounter the phenomenon (compare Remark 16. ip that the geodesic diameter of 
certain totally geodesic suhmanifolds is strictly larger than the geodesic diameter of the 
ambient space G2(C"^^) , which equals ^ -v/2 • As in the case of G2(H"+2) ^ this is true of 
the totally geodesic suhmanifolds of type {S,ip = arctan(i),2) (diameter ^ VW ), and of 
those of the types (P,9? = arctan(^),r) (diameter ^ \/5). 

Of course, one would also like to understand totally geodesic, isometric embeddings into 
G2{G^~^'^) for the various types of its Lie triple systems. For the most part they can be easily 
obtained by appropriately restricting embeddings into G2(1H"'+^) described in Section [6l So we 
here discuss only the "unexpected" types (§, 99 = arctan(i), 2) and (P, = arctan(i), r) . 

Type (IP, (f = arctan(^), r) . In particular we wish to construct a totally geodesic submani- 
fold of type (P, (p = arctan(^), (C, 2)) , which is maximal in G2{G^) . For this, we continue the 
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discussion of the type = arctan(^), (]H,2)) in Section [U and use the objects introduced 

there. 

We fix a complex form W*^ of W (i.e. a complex-3-dimensional, totahy complex subspace of 
(W,t) ). Under the action of SU(VF^) ^ SU(3) on W (where B G SU(1^^) acts via {B')^^^ 
with the unique endomorphism B' G Sp(VF) with = ) the complex- 9-dimensional 

space L spanned by 

{ r 6,, A 62 A 63 , 61 A r 6^ A 63 , 61 A 62 A r 6^ | u e {1,2,3} } 

is invariant (where again (61, 62,^3) is a symplectic basis of W); therefore also the complex-6- 
dimensional space V'^ :=VnL is invariant under that action. 

Consider the complex Grassmannian ^2(1/^) = G2{0) . We have C/^ := C/n G G2(^^) • 
It is easily seen that the isotropy group of the action of SU(VF*'^) on G2{V'^) at the point U'^ 
equals S(U(M^2 p ^C) ^ u(l^i n W'^)) , and therefore the orbit M*^ of that action through U'^ 
is a totally geodesic submanifold of G2{V'^) of type (IP, ip = arctan(i), (C, 2)) . 

Similarly, we can construct a totally geodesic submanifold of type (P, ip = arctan(i), (IR, 2)) ; 
they are not maximal in G2(C^) , but they are maximal in a totally geodesic submanifold of type 
(G2,(]R,3)), i.e. in a G2(]R^). 

For this we fix a real form of W'^ . Then © t{W^) is a real form of the unitary 

space W , and therefore /\^ W := spauj^j wi f\W2 f\wz\wi,W2,wz £ © t{W^) } is a real 
form of 1^ • The group S0(T4^^) = S0(3) acts on /\^ W in the obvious way, and Ar W is 
invariant under that action; therefore also the real-6-dimensional space V'^ H Ak, ^ ■ 

Moreover, we have 5(3) (() = ( for every B G SO(VK^) , where 

:= r 61 A 62 A 63 + 61 A T 62 A 63 + 61 A 62 A T 63 G n Ar • 

(Indeed, the map a : End(VF'^) — > IR, B {B^^\,0 is multi-linear and alternating in 

the columns of 5 G End(l^'^) , for B G SO(iy^) we hence have a{B) = det{B) • a(id) = 1 , 
therefrom B^^\Q = follows.) Therefore also the real-5-dimensional space 
l\l^W n (IRC)"^ is invariant under S0(I7'^) . 

We now consider the real Grassmannian G2(y^) = G2(]R^) . With analogous arguments 
as before one sees: The orbit of the SO(VF'^)-action on G2{y^) through the point := 
jj€ f-^yM g G2iV'^) is a totally geodesic submanifold of type (JP,ip = arctan(i), (IR, 2)) , 
isometric to IRP^ . 

Type {S,(p = arctan(|), 2) . The totally geodesic submanifolds of this type can be con- 
structed in the following way: G2(C^) is holomorphically isometric to the oriented, real 
2-Grassmannian G^(IR^) (the 4-dimensional complex quadric), it therefore contains totally 
geodesic submanifolds isometric to G^(IR^) (of type {Q3))- G^(IR^) is a two- fold cover- 
ing manifold over G2(]R^) (the covering map being given by "forgetting" the orientation of 
U G G^(IR^) ). The pre-image M under this covering map of a totally geodesic submanifold of 
G2(]R^) of type (§,(/? = arctan(i), (IR, 2)) (isometric to IRP^ ) is of course a totally geodesic 
submanifold of G^(IR^) ; it turns out that M is connected, and therefore isometric to a 2-sphere. 

Seen as a totally geodesic submanifold of G^(IR^) (which is isomorphic to the complex 
quadric Q^) M is of type (A) of my classification of totally geodesic submanifolds of the 
complex quadrics in [K]; seen as a totally geodesic submanifold of G2(C^), M is of type 
(S, 99 = arctan(^), 2) of the present classification. 
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